-- Logs begin at Tue 2021-04-20 17:40:31 UTC, end at Tue 2021-04-20 19:18:59 UTC. -- Apr 20 18:13:35.069435 dv-cinder-786930-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 18:13:35.077579 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 18:13:35 2021] *** Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: nodename: dv-cinder-786930-2-iscsi Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: machine: x86_64 Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: clock source: unix Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: pcre jit disabled Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: detected number of CPU cores: 4 Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: current working directory: / Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: detected binary path: /usr/bin/uwsgi-core Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: dropping root privileges as early as possible Apr 20 18:13:35.079650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: your processes number limit is 47843 Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: your memory page size is 4096 bytes Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: detected max file descriptor number: 2048 Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: lock engine: pthread robust mutexes Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: thunder lock: enabled Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: dropping root privileges after socket binding Apr 20 18:13:35.080685 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 18:13:35.125747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: Python main interpreter initialized at 0x5639742329c0 Apr 20 18:13:35.125747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: dropping root privileges after plugin initialization Apr 20 18:13:35.125747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: python threads support enabled Apr 20 18:13:35.125747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: your server socket listen backlog is limited to 100 connections Apr 20 18:13:35.125747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: your mercy for graceful operations on workers is 90 seconds Apr 20 18:13:35.126193 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 18:13:35.126193 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: *** Operational MODE: preforking *** Apr 20 18:13:35.126363 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: dropping root privileges after application loading Apr 20 18:13:35.126363 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: *** uWSGI is running in multiple interpreter mode *** Apr 20 18:13:35.126363 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: spawned uWSGI master process (pid: 85680) Apr 20 18:13:35.126536 dv-cinder-786930-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 18:13:35.126981 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: spawned uWSGI worker 1 (pid: 85681, cores: 1) Apr 20 18:13:35.127933 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: spawned uWSGI worker 2 (pid: 85682, cores: 1) Apr 20 18:13:35.127933 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 18:13:40.093938 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:13:40.094448 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:13:40.095731 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:13:40.096171 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:13:40.096468 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:13:40.096935 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.097305 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.097675 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.098583 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.098970 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.099325 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.099696 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.100058 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.100435 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.100735 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.101095 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.101467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786930-2-iscsi {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.101840 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.102190 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.102569 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.102681 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:13:40.102946 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.103103 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:13:40.103291 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.103663 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.104015 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.104487 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:13:40.104637 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.104914 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:13:40.105016 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.105204 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:13:40.105311 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.105636 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.105743 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.105996 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.106101 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.106357 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.106479 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.106733 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.106915 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.107098 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.107204 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.107445 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.107543 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.107808 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.107961 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.108144 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.108250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.108507 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.108607 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786930-2-iscsi {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.108799 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.108905 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.109150 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.109254 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.109513 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.109622 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786930-2-iscsi {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.109868 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.110008 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.110213 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.110361 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.110592 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.110708 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.110954 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.111079 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.111298 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.111400 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.111661 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.111767 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.112003 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.112108 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.112435 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.112623 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.112807 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.112993 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.113175 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.113286 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.113520 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.113618 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.114443 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.114566 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.114818 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.114918 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.115186 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.115285 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.115536 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.115649 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.115875 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.115975 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.116157 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.116262 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.116511 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.116628 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.116881 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117032 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786930-2-iscsi {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117222 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117327 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117571 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117672 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117862 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.117963 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.118151 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.118371 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.118517 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.118746 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.118856 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.119091 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.119197 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.119453 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.119553 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.119813 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.119939 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.120158 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.120258 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.120507 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.120607 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.120857 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.120964 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.121207 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.121365 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.121557 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.121664 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.121887 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.122004 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.122233 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.122341 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.122604 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.122709 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.122954 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.123070 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.123287 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.123389 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.123625 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.123731 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.22 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.123908 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.124018 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.22 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.124252 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.124352 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.124615 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.124714 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.124978 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.125085 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.125343 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.125443 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.125628 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.125732 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.125911 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.126017 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.126271 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.126377 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.126660 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.126773 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.127008 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.127109 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.127353 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.127452 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.127696 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.127802 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.128035 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.128174 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.128327 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.128427 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.128672 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.128779 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.129005 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.129110 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.129406 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.129505 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.129766 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.129872 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.130124 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.130253 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.130488 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.130596 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.130839 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.130952 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.131191 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.131307 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.131537 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.131648 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.22 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.131886 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.131987 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.22 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.132220 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.132327 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.132560 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.132660 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.132905 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.133006 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.133252 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.133376 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.133591 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.133691 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.133939 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.134040 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.134272 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.134378 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.134638 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.134740 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.134984 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.135090 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.135341 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.135440 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.135691 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.135798 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136023 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136128 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136304 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136414 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136638 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136750 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.136978 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.137076 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.137334 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.137436 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.137674 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.137780 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.138012 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.138112 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.138344 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.138443 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.138703 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.138815 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.139042 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.139141 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.139382 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.139486 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.139718 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.139827 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.140060 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.140212 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.140390 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.140496 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.140729 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.140829 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.141067 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.141173 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.141406 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.141510 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.141738 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.141845 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.142076 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.142175 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.142422 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.142540 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.142784 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.142891 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.143122 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.143221 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.143455 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.143554 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.143798 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.143898 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.144156 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.144255 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.144497 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.144595 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.144830 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.144930 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.145195 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.145294 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.145527 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.145634 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.145868 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.145967 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.146224 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.146329 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.146588 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.146703 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.146931 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.147030 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.147287 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.147397 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.147620 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.147727 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.147961 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.148061 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.148319 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.148418 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.148657 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.148767 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.148994 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.149094 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.149330 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.149430 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.149666 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.149766 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.150001 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.150109 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.150343 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.150488 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.150713 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.150819 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.151050 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.151153 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.151382 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.151482 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.151737 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.151854 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.152089 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.152189 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.152422 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.152522 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.152762 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.152863 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.153100 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.153199 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.153476 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:13:40.153576 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.153799 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.153914 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.154164 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.154273 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.154572 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.154687 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.155175 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.155277 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.155541 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.155648 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.155890 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.155997 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.156241 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.156364 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.156588 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.156712 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.156938 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.157038 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.157294 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.157414 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.157634 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.157813 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.157980 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.158087 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.158326 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.158426 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.158713 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.158826 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.159066 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.159166 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.159425 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.159524 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.159769 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.159870 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.160110 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.160217 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.160462 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.161076 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.161332 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.161433 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.161674 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.161781 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.162030 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.162136 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.162388 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.162511 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.162760 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.162872 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.163141 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.163240 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.163484 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.163584 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.163839 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.163956 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.164194 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.164295 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.164534 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.164634 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.164883 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.164990 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.165230 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.165337 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.165570 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.165670 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.165912 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.166022 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.166264 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.166364 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.166633 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.166758 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.166974 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.167086 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.167326 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.167426 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.167671 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.167780 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.168022 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.168123 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.168355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.168461 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.168696 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.168796 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.169039 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.169141 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.169384 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.169485 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.169725 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.169824 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.170071 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.170172 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.170433 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.170598 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.170803 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.170910 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.171147 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.171248 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.171494 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.171594 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.171841 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.171948 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.172189 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.172289 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.172530 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.172631 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.172875 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.173000 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.173212 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.173313 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.173546 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.173647 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.173888 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.174018 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.174230 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.174337 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.174594 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.174712 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.174937 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.175046 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.175273 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.175374 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.175610 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.175716 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.175954 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.176062 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.176881 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.177006 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.177230 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.177340 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.177598 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.177695 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.177911 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.178021 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.178257 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.178358 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.178631 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.178744 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.178992 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.179092 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.179361 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.179462 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.179705 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.179805 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.180066 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.180166 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.180419 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.180519 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.180768 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.180879 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.181099 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.181199 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.181438 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.181546 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.181769 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.181869 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.182111 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.182242 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.182450 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.182584 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.182821 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.182927 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.183164 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.183269 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.183496 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.183616 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.183836 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.183987 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.184177 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.184276 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.184517 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.184629 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.184863 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.184970 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.185200 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.185301 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.185542 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.185649 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.185882 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.185982 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.186223 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.186332 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.186590 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.186694 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.186939 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.187040 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.187296 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.187396 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.187640 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.187750 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.187987 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.188088 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.188333 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.188433 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.188673 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.188780 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.189007 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.189107 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.189348 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.189448 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.189693 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.189795 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.190040 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.190140 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.190374 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.190489 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.190757 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.190859 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.191100 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.191200 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.191448 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.191559 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.191829 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.191929 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.192179 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.192280 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.192526 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.192647 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.192877 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.192983 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.193222 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.193329 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.193567 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.193687 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.193908 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.194037 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.194249 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.194360 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.194618 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.194751 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.194941 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.195052 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.195289 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.195390 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.195640 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.195749 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.195980 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.196080 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.196329 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.196429 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.196670 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.196770 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.197019 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.197108 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.197356 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.197465 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.197698 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.197799 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.198038 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.198138 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.198384 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.198504 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.198765 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.198866 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.199111 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.199212 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.199464 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.199571 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.199817 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.199918 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.200151 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.200250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.200498 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.200606 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.200846 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201012 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201164 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201314 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201476 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201642 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201793 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.201942 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.202090 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.202239 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.202491 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.202848 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.202957 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.203189 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.203289 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.203542 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.203644 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.203901 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.204003 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.204243 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.204355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.204593 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.204694 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.204942 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.205043 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.205288 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.205388 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.205635 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.205744 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.205978 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.206078 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.206324 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.206424 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.206697 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.206807 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.207037 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.207158 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.207406 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.207518 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.207759 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.207869 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.208110 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.208233 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.208450 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.208560 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.208798 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.208907 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.209136 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.209236 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.209475 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.209582 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.209812 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.209914 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.210153 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.210260 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.210531 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.210866 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.211038 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.211212 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.211312 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.211559 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.211660 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.211913 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.212022 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.212259 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.212359 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.212609 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.212722 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.212956 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.213068 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.213303 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.213403 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.213647 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.213746 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.213994 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.214107 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.214345 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.214444 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.214714 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.214824 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.215057 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.215158 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.215407 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.215507 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.215751 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.215856 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.216094 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.216195 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.216435 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.216541 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.216775 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.216875 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.217116 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.217217 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.217449 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.217549 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.217786 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.217885 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.218120 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.218221 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.218497 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.218613 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.218835 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.218943 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.219171 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.219271 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.219506 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.219606 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.219849 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.219957 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.220189 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.220289 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.220526 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.220626 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.220861 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.220968 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.221198 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.221322 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.221551 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.221653 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.221888 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.222057 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.222226 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.222327 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.222618 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.222723 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.222974 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.223589 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.223842 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.223943 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.224187 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.224293 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.224534 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.224653 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.224864 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.224965 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.225203 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.225303 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.225548 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.225655 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.225894 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.225994 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.226232 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.226332 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.226611 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.226716 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.226963 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.227064 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.227301 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.227410 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.227642 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.227755 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.227984 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.228084 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.228323 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.228430 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.228669 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.228769 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.229002 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.229102 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.229338 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.229448 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.229669 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.229770 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.230016 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.230116 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.230360 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.230498 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.230728 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.230829 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.231077 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.231190 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.231419 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.231538 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.231758 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.231864 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.232105 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.232212 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.232445 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.232551 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.232784 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.232889 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.233130 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.233230 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.233495 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.233595 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.233844 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.233944 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.234177 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.234278 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.234548 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.234670 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.234895 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.235007 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.235236 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.235346 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.235575 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.235733 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.235882 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.236031 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.236225 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.236389 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.236551 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.236700 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.236857 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.237005 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.237155 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.237302 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.237499 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.237650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.237864 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.238018 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.238211 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.238370 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.238587 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.239303 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.239480 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.239650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.239800 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.239961 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.240112 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.240261 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.240474 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.240626 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.240830 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.240992 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.241186 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.241349 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.241554 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.241732 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.241882 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.242042 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.242190 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.242355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.242530 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.242679 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.242870 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243016 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243166 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243314 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243508 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243671 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243834 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.243983 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.244145 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.244293 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.244495 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.244659 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.244828 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.244977 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.245126 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.245274 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.245482 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.245634 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.245831 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.245989 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.246187 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.246338 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.246558 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.246664 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.246910 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.247011 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.247279 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.247395 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.247609 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.247717 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.247959 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.248061 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.248305 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.248411 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.248654 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.248765 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.248997 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.249096 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.249346 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.249445 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.249695 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.249803 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.250045 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.250145 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.250391 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.250510 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.250769 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.250887 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.251109 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.251208 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.251444 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.251544 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.251807 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.251927 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.252149 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.252250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.252488 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.252587 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.252829 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.252930 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.253174 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.253275 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.253513 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.253620 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.253849 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.253951 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.254354 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.254454 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.254745 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.254846 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.255088 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.255189 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.255423 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.255564 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.255772 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.255921 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.256122 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.256277 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.256476 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.256649 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.256826 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.257023 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.257169 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.257395 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.257644 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.257744 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.258000 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.258107 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.258352 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.258474 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.258731 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.258841 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.259078 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.259185 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.259421 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.259526 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.259771 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.259871 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.260121 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.260229 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.260456 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.260555 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.260800 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.260906 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.261149 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.261250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.261510 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.261611 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.261844 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.261954 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.262207 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.262309 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.262678 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.262783 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.263031 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.263168 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.263377 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.263479 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.263721 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.263827 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.264070 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.264170 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.264426 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.264527 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.264774 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.264906 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.265125 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.265233 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.265499 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.265599 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.265835 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.265933 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.266184 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.266290 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.266551 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.266653 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.266918 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.267028 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.267266 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.267378 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.267608 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.267708 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.267961 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.268091 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.268302 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.268410 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.268661 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.268768 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.269012 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.269118 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.269355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.269462 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.269720 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.269826 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.270089 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.270194 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.270521 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.270626 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.270867 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.270978 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.271218 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.271319 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.271567 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.271668 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.271904 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.272015 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.272248 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.272348 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.272595 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.272696 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.272937 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.273036 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.273280 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.273380 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.273644 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.273744 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.273986 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.274091 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.274335 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.274446 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.274713 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.274820 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.275068 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.275178 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.275426 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.275537 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.275771 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.275871 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.276112 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.276218 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.276449 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.276560 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.276797 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.276897 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.277141 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.277241 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.277482 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.277592 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.277834 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.277933 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.278170 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.278269 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.278532 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.278647 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.278882 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.278982 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.279222 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.279321 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.279563 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.279664 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.280160 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.280262 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.280538 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.280637 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.280871 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.280971 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.281211 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.281320 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.281560 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.281668 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.281910 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.282010 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.282253 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.282356 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.282648 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.282752 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.283003 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.283115 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.283358 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.283457 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.283712 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.283821 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.284076 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.284191 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.284418 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.284518 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.284759 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.284865 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.285104 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.285213 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.285443 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.286046 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.286320 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.286421 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.286690 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.286967 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.287069 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.287355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.287467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.287719 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.287878 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.288148 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.288287 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.288517 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.288633 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.288860 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.288973 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.289226 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.289327 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.289575 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.289684 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.289920 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.290172 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.290277 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.290570 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.290688 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.290943 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.291053 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.291301 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.291401 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.291660 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.291767 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.292009 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.292149 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.292358 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.292460 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.292713 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.292815 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.293053 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.293161 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.293401 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.293503 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.293751 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.293851 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.294103 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.294204 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.294506 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.294611 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.294838 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.294960 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.295190 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.295309 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.295541 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.295659 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.295894 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.296007 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.296232 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.296342 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.296582 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.296701 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.296935 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.297055 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.297289 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.297405 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.297648 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.297875 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.297985 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.298244 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.298354 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.298623 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.298737 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.298976 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.299111 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.299329 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.299432 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.299686 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.299794 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.300038 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.300203 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.300389 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.300498 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.300738 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.300839 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.301089 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.301772 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.302006 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.302124 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.302368 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.302504 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.302767 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.302878 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.303126 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.303228 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.303492 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.303581 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.303832 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.303942 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.304183 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.304307 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.304528 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.304784 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.304892 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.305144 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.305245 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.305525 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.305626 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.305901 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.306003 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.306250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.306351 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.306634 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.306762 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.306991 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.307094 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.307340 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.307440 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.307688 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.307788 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.308032 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.308191 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.308379 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.308466 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.308724 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.308840 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.309067 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.309170 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.309410 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.309512 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.309761 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.309870 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.310104 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.310191 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.310480 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.310592 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.310843 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.310960 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.311188 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.311467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.311574 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.311870 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.311970 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.312226 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.312458 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.312604 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.312808 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.312980 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.313178 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.313344 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.313543 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.313699 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.313907 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.314073 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.314258 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.314425 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.314632 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.314805 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.314981 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.315168 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.315324 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.315524 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.315666 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.315875 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.316015 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.316224 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.316333 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.316580 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.316687 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.316962 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.317072 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.317312 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.317421 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.317668 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.317769 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.318016 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.318116 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.318362 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.318491 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.318733 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.318997 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.319098 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.319395 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.319507 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.319742 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.319843 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.320092 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.320201 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.320443 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.320554 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.320789 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.320889 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.321129 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.321229 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.321485 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.321597 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.321824 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.321925 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.322165 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.322271 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.322527 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.322651 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.322870 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.322972 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.323210 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.323311 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.323542 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.323643 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.323885 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.324021 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.324224 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.324328 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.324565 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.324668 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.324902 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.325005 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.325234 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.325336 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.325585 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.325694 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.325918 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.326019 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.326261 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.326362 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.326626 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.326729 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.326978 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.327080 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.327321 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.327421 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.327664 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.327944 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.328045 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.328318 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.328420 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.328667 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.328826 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.328993 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.329157 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.329316 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.329467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.329623 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.329774 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.329934 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.330087 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.330237 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.330385 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.330591 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.330759 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.330908 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.331110 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.331282 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.331467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.331633 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.331789 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.331941 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.332147 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.332299 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.333016 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.333174 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.333372 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.333537 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.333687 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.333839 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.334033 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.334138 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.334379 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.334500 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.334759 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.334861 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.335150 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.335355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.335513 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.335730 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.335873 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.336090 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.336234 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.336474 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.336581 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.336859 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.336967 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.337206 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.337308 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.337550 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.337650 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.337892 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.337993 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.338246 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.338348 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.338617 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.338733 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.338970 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.339087 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.339317 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.339419 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.339665 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.339771 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.340008 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.340109 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.340354 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.340455 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.340700 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.340810 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.341046 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.341154 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.341840 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.341952 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.342229 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.342330 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.342634 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.342811 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.342988 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.343142 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.343345 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.343451 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.343683 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.343797 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.344072 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.344185 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.344379 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.344481 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.344718 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.344820 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.345066 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.345167 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.345412 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.345512 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.345764 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.345866 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.346137 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.346239 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.346495 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.346609 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.346854 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.346962 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.347204 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.347316 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.347562 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.347662 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.347917 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.348018 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.348865 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.348974 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.349205 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.349314 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.349566 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.349667 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.349922 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.350023 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.350285 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.350394 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.350660 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.350762 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.351015 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.351127 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.351358 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.351467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.351701 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.351801 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.352047 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.352147 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.352407 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.352516 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.352778 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.352878 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.353129 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.353235 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.353483 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.353595 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.353829 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.353930 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.354182 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.354282 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.354555 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.354660 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.354901 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.355012 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.355250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.355351 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.355599 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.355701 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.355945 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.356044 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.356293 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.356393 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.356652 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.356754 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.356999 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.357106 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.357356 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.357456 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.357695 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.357797 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.358039 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.358146 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.358372 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.358500 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.358752 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.358859 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.359103 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.359238 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.359444 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.359558 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.359811 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.359914 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.360162 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.360263 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.360517 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.360626 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.360856 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.360967 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.361213 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.361314 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.361552 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.361665 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.361917 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.362018 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.362272 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.362372 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.362644 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.362748 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.362987 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.363088 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.363337 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.363447 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.363697 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.363805 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.364049 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.364172 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.364399 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.364511 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.364742 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.364849 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.365091 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.365191 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.365439 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.365547 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.365805 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.365905 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.366163 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.366265 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.366526 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.366644 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.366827 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85681) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:13:40.366929 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.367220 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.367576 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.367929 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.368278 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.368649 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.368996 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.369348 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.369695 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.370042 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.370395 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.370777 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.371141 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.371505 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.371873 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.372238 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.372624 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.372974 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.373355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.373724 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:13:40.373999 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85682) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:13:40.402020 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85681) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.408753 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.741266 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.context [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fed6a0e7-292a-432d-90d4-b7835fd301db(cell1) {{(pid=85681) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:13:40.744747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.context [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fed6a0e7-292a-432d-90d4-b7835fd301db(cell1) {{(pid=85682) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:13:40.746827 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:13:40.748772 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:13:40.749649 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:13:40.750153 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85682) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:13:40.751794 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:13:40.752133 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85682) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:13:40.753023 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85682) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:13:40.755646 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85682) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:13:40.778409 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85681) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.781617 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85681) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.788602 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.794579 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.813897 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85681) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.821596 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_db.sqlalchemy.engines [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:13:40.912309 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:13:40.912309 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: from cryptography.utils import int_from_bytes Apr 20 18:13:40.912694 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:13:40.912694 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: from cryptography.utils import int_from_bytes Apr 20 18:13:40.912906 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:13:40.912906 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: from cryptography.utils import int_from_bytes Apr 20 18:13:40.913248 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:13:40.913248 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: from cryptography.utils import int_from_bytes Apr 20 18:13:40.990223 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading Gnome Apr 20 18:13:40.990559 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading Gnome Apr 20 18:13:41.011496 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading Google Apr 20 18:13:41.012458 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading Google Apr 20 18:13:41.014856 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading Windows (alt) Apr 20 18:13:41.015804 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading Windows (alt) Apr 20 18:13:41.019407 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading file Apr 20 18:13:41.021067 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading keyczar Apr 20 18:13:41.021177 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading file Apr 20 18:13:41.021516 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading multi Apr 20 18:13:41.022249 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading keyczar Apr 20 18:13:41.022351 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Loading pyfs Apr 20 18:13:41.022735 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading multi Apr 20 18:13:41.023612 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO keyring.backend [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Loading pyfs Apr 20 18:13:41.298213 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:13:41.300949 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:13:41.305827 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:13:41.308628 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:13:41.637485 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:13:41.642262 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:13:41.643049 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:13:41.648022 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WARNING keystonemiddleware.auth_token [None req-cac032dd-c7f3-46bd-a682-cf5f0d11bf27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:13:41.649362 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639742329c0 pid: 85682 (default app) Apr 20 18:13:41.651630 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:13:41.652799 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] 10.222.0.22 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Apr 20 18:13:41.653230 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 1/1] 10.222.0.22 () {50 vars in 779 bytes} [Tue Apr 20 18:13:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:13:41.654369 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639742329c0 pid: 85681 (default app) Apr 20 18:15:05.343968 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:05.345035 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Apr 20 18:15:05.345453 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 2/2] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:05.836692 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-a4c58170-f01d-42e8-b533-2d8c3b2a2d33 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:05.864606 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-a4c58170-f01d-42e8-b533-2d8c3b2a2d33 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.511746 Apr 20 18:15:05.865355 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 1/3] 10.222.0.22 () {60 vars in 1281 bytes} [Tue Apr 20 18:15:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:08.365666 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:08.366911 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-c5a0bde7-fcf1-42c8-9a87-30d23345e85d None None] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Apr 20 18:15:08.367513 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 3/4] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:08.431508 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-0051984d-57b5-470d-b143-5a578636a102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:08.456559 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:15:08.456559 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:15:08.486473 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-0051984d-57b5-470d-b143-5a578636a102 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112278 Apr 20 18:15:08.487226 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 2/5] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:08.798501 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-0bbd6b1e-9a25-411e-b1e5-1cd022ce7ebf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:08.802824 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:15:08.802824 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:15:08.850045 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-0bbd6b1e-9a25-411e-b1e5-1cd022ce7ebf admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.354100 Apr 20 18:15:08.850839 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 4/6] 10.222.0.22 () {64 vars in 1325 bytes} [Tue Apr 20 18:15:08 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:11.367562 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-0051984d-57b5-470d-b143-5a578636a102 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:11.368644 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-0051984d-57b5-470d-b143-5a578636a102 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Apr 20 18:15:11.369086 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 3/7] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:11.493225 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-2790f3e2-b27b-4614-85b0-212c1cf0e37a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "disk": 5}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:11.516635 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:15:11.516635 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:15:11.543316 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-2790f3e2-b27b-4614-85b0-212c1cf0e37a admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167384 Apr 20 18:15:11.543992 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 5/8] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:11.557122 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-3d9b2753-0913-42d7-a8b2-3539ce251739 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:11.558794 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:15:11.558794 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:15:11.595162 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-3d9b2753-0913-42d7-a8b2-3539ce251739 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041993 Apr 20 18:15:11.596339 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 4/9] 10.222.0.22 () {64 vars in 1325 bytes} [Tue Apr 20 18:15:11 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:14.098666 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-2790f3e2-b27b-4614-85b0-212c1cf0e37a admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:14.099735 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-2790f3e2-b27b-4614-85b0-212c1cf0e37a admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Apr 20 18:15:14.100158 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 6/10] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:14.163345 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-13e92ed5-bae4-4380-af3d-6d8fed4f349d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "swap": 0}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:14.190662 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-13e92ed5-bae4-4380-af3d-6d8fed4f349d admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083481 Apr 20 18:15:14.191259 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 5/11] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:14.204845 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-7bc842f3-d8e1-40c5-acb0-a284048ba4e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:14.243465 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-7bc842f3-d8e1-40c5-acb0-a284048ba4e9 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042955 Apr 20 18:15:14.250286 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 7/12] 10.222.0.22 () {64 vars in 1325 bytes} [Tue Apr 20 18:15:14 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:16.806818 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-13e92ed5-bae4-4380-af3d-6d8fed4f349d admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:16.807891 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-13e92ed5-bae4-4380-af3d-6d8fed4f349d admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Apr 20 18:15:16.808321 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 6/13] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:16.869917 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-40fd0977-cb56-47e3-9cc9-e0d8f38dfe09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:16.899467 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-40fd0977-cb56-47e3-9cc9-e0d8f38dfe09 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083653 Apr 20 18:15:16.900085 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 8/14] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:16.914021 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-51fe4087-5e33-4d3f-920b-1df8c812aa9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:16.953170 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-51fe4087-5e33-4d3f-920b-1df8c812aa9e admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043366 Apr 20 18:15:16.953773 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 7/15] 10.222.0.22 () {64 vars in 1325 bytes} [Tue Apr 20 18:15:16 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:19.467581 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-40fd0977-cb56-47e3-9cc9-e0d8f38dfe09 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:19.468681 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-40fd0977-cb56-47e3-9cc9-e0d8f38dfe09 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Apr 20 18:15:19.469136 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 9/16] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:19.540267 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-5d0433e9-03d2-407c-b192-00ddcdd36c32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:19.566013 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-5d0433e9-03d2-407c-b192-00ddcdd36c32 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088134 Apr 20 18:15:19.566831 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 8/17] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:19.580941 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-b3fb38e1-3111-49c4-b681-de21a77a3df8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:19.624365 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-b3fb38e1-3111-49c4-b681-de21a77a3df8 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048524 Apr 20 18:15:19.625024 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 10/18] 10.222.0.22 () {64 vars in 1325 bytes} [Tue Apr 20 18:15:19 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:22.134949 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-5d0433e9-03d2-407c-b192-00ddcdd36c32 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:22.136022 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-5d0433e9-03d2-407c-b192-00ddcdd36c32 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Apr 20 18:15:22.136482 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 9/19] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:15:22.199061 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-61eb396d-8d40-4c41-8b3f-1c81eb0ca476 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:22.229744 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-61eb396d-8d40-4c41-8b3f-1c81eb0ca476 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085969 Apr 20 18:15:22.230339 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 11/20] 10.222.0.22 () {60 vars in 1281 bytes} [Tue Apr 20 18:15:22 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:15:25.051190 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-5d0433e9-03d2-407c-b192-00ddcdd36c32 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:25.052494 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-5d0433e9-03d2-407c-b192-00ddcdd36c32 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Apr 20 18:15:25.053062 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 10/21] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:25 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:15:25.116943 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-72cbf9fb-e122-4c06-a4b8-013adf119aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:25.141876 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-72cbf9fb-e122-4c06-a4b8-013adf119aaa admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081063 Apr 20 18:15:25.142471 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 12/22] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:25 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:25.157382 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-6fb61173-8dea-4a88-af6c-cd347e7039e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:25.203697 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-6fb61173-8dea-4a88-af6c-cd347e7039e4 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051949 Apr 20 18:15:25.204484 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 11/23] 10.222.0.22 () {64 vars in 1322 bytes} [Tue Apr 20 18:15:25 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:28.013138 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-72cbf9fb-e122-4c06-a4b8-013adf119aaa admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:28.014214 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-72cbf9fb-e122-4c06-a4b8-013adf119aaa admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Apr 20 18:15:28.014762 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 13/24] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:28.075504 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-416f35e4-25d9-4381-8b23-0c9b2adab168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "rxtx_factor": 1.0}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:28.099765 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-416f35e4-25d9-4381-8b23-0c9b2adab168 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078004 Apr 20 18:15:28.100364 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 12/25] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:28.113592 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-0929d02c-f13e-4ca4-ad11-18a2ace7d9b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:28.151176 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-0929d02c-f13e-4ca4-ad11-18a2ace7d9b9 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041645 Apr 20 18:15:28.151777 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 14/26] 10.222.0.22 () {64 vars in 1322 bytes} [Tue Apr 20 18:15:28 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:30.661384 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-416f35e4-25d9-4381-8b23-0c9b2adab168 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:30.662476 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-416f35e4-25d9-4381-8b23-0c9b2adab168 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Apr 20 18:15:30.663170 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 13/27] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:30.728346 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-80338a3e-62ed-4086-9966-b38d57a10875 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:30.754682 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-80338a3e-62ed-4086-9966-b38d57a10875 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084712 Apr 20 18:15:30.755727 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 15/28] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:30 2021] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:15:30.769783 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-2beeb47f-1941-43ae-a2b3-66af58c1d082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:30.815302 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-2beeb47f-1941-43ae-a2b3-66af58c1d082 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049597 Apr 20 18:15:30.816189 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 14/29] 10.222.0.22 () {64 vars in 1322 bytes} [Tue Apr 20 18:15:30 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:33.322203 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-80338a3e-62ed-4086-9966-b38d57a10875 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:33.323747 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-80338a3e-62ed-4086-9966-b38d57a10875 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Apr 20 18:15:33.324166 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 16/30] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:33.391384 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-c6cd51ea-74cb-4677-bff6-5af031f41266 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:33.419889 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-c6cd51ea-74cb-4677-bff6-5af031f41266 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088506 Apr 20 18:15:33.420482 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 15/31] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:33.434470 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-363db9ea-c9a7-403f-989c-d7020920be08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:33.478240 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-363db9ea-c9a7-403f-989c-d7020920be08 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047598 Apr 20 18:15:33.479252 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 17/32] 10.222.0.22 () {64 vars in 1322 bytes} [Tue Apr 20 18:15:33 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:15:36.067937 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-c6cd51ea-74cb-4677-bff6-5af031f41266 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:15:36.069019 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-c6cd51ea-74cb-4677-bff6-5af031f41266 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Apr 20 18:15:36.070656 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 16/33] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:15:36 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:15:36.137163 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-a302633a-cebc-4a37-9fd9-0387ee1bca6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5"}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:36.165486 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-a302633a-cebc-4a37-9fd9-0387ee1bca6f admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089418 Apr 20 18:15:36.166406 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 18/34] 10.222.0.22 () {64 vars in 1272 bytes} [Tue Apr 20 18:15:36 2021] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:15:36.179210 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-0371c271-58bf-46f7-9c3e-8e1c5bc64fa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:15:36.216825 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-0371c271-58bf-46f7-9c3e-8e1c5bc64fa7 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041532 Apr 20 18:15:36.217570 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 17/35] 10.222.0.22 () {64 vars in 1322 bytes} [Tue Apr 20 18:15:36 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:16:15.975318 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-a302633a-cebc-4a37-9fd9-0387ee1bca6f admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:15.976381 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-a302633a-cebc-4a37-9fd9-0387ee1bca6f admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Apr 20 18:16:15.976815 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 19/36] 10.222.0.22 () {54 vars in 920 bytes} [Tue Apr 20 18:16:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:16.037568 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-56854b17-ed6f-4c93-b565-f11103c1777c admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:16.062883 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-56854b17-ed6f-4c93-b565-f11103c1777c admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079577 Apr 20 18:16:16.064061 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 18/37] 10.222.0.22 () {60 vars in 1281 bytes} [Tue Apr 20 18:16:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:16:17.725743 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-a302633a-cebc-4a37-9fd9-0387ee1bca6f admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:17.726830 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-a302633a-cebc-4a37-9fd9-0387ee1bca6f admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 20 18:16:17.727271 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 20/38] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:17.908455 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-a950072c-485c-4356-a99e-5799139d2574 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:17.923065 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.wsgi [None req-a950072c-485c-4356-a99e-5799139d2574 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 18:16:17.923696 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-a950072c-485c-4356-a99e-5799139d2574 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:16:17.924542 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-a950072c-485c-4356-a99e-5799139d2574 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.069431 Apr 20 18:16:17.925089 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 19/39] 10.222.0.22 () {60 vars in 1181 bytes} [Tue Apr 20 18:16:17 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:16:17.934991 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-455a1708-78e9-48c7-9590-d2c66055fd2e admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:17.956292 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-455a1708-78e9-48c7-9590-d2c66055fd2e admin admin] 10.222.0.22 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025146 Apr 20 18:16:17.956848 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 21/40] 10.222.0.22 () {60 vars in 1201 bytes} [Tue Apr 20 18:16:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:16:17.966697 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-933b37cf-bb48-430b-99d2-1c504e18b769 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:17.989097 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-933b37cf-bb48-430b-99d2-1c504e18b769 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026039 Apr 20 18:16:17.989659 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 20/41] 10.222.0.22 () {60 vars in 1201 bytes} [Tue Apr 20 18:16:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:16:17.999261 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-7f9e3ece-e5e2-4ca2-a2a5-1550bf236842 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:18.014061 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.wsgi [None req-7f9e3ece-e5e2-4ca2-a2a5-1550bf236842 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 18:16:18.014717 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-7f9e3ece-e5e2-4ca2-a2a5-1550bf236842 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:16:18.015547 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-7f9e3ece-e5e2-4ca2-a2a5-1550bf236842 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.020053 Apr 20 18:16:18.016079 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 22/42] 10.222.0.22 () {60 vars in 1181 bytes} [Tue Apr 20 18:16:17 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:16:19.566776 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-933b37cf-bb48-430b-99d2-1c504e18b769 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:19.567852 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-933b37cf-bb48-430b-99d2-1c504e18b769 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Apr 20 18:16:19.568335 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 21/43] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:19.748416 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-83f7c592-0c6d-4c42-943c-77badb393fe5 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:19.761290 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.wsgi [None req-83f7c592-0c6d-4c42-943c-77badb393fe5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 18:16:19.761898 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-83f7c592-0c6d-4c42-943c-77badb393fe5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:16:19.762749 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-83f7c592-0c6d-4c42-943c-77badb393fe5 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.068368 Apr 20 18:16:19.763307 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 23/44] 10.222.0.22 () {60 vars in 1181 bytes} [Tue Apr 20 18:16:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:16:19.773736 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-ec5baea6-8811-4f7c-a710-43f273c8f059 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:19.795663 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-ec5baea6-8811-4f7c-a710-43f273c8f059 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025794 Apr 20 18:16:19.796251 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 22/45] 10.222.0.22 () {60 vars in 1201 bytes} [Tue Apr 20 18:16:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:16:19.806589 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-73959242-719e-4240-b5ba-7dd571f7ed63 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:19.827727 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-73959242-719e-4240-b5ba-7dd571f7ed63 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025026 Apr 20 18:16:19.828289 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 24/46] 10.222.0.22 () {60 vars in 1201 bytes} [Tue Apr 20 18:16:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:16:19.838597 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-9baa2675-ed0f-4b33-bfe1-c267f3ce1751 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:19.851946 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.wsgi [None req-9baa2675-ed0f-4b33-bfe1-c267f3ce1751 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 18:16:19.852558 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-9baa2675-ed0f-4b33-bfe1-c267f3ce1751 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:16:19.853389 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-9baa2675-ed0f-4b33-bfe1-c267f3ce1751 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018648 Apr 20 18:16:19.853927 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 23/47] 10.222.0.22 () {60 vars in 1181 bytes} [Tue Apr 20 18:16:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:16:21.418368 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-73959242-719e-4240-b5ba-7dd571f7ed63 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:21.419482 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-73959242-719e-4240-b5ba-7dd571f7ed63 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Apr 20 18:16:21.419914 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 25/48] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:21.598840 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-e4d9eae2-a8a9-4a2e-bea9-a0a5de97c520 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:21.611509 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.wsgi [None req-e4d9eae2-a8a9-4a2e-bea9-a0a5de97c520 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 18:16:21.612115 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-e4d9eae2-a8a9-4a2e-bea9-a0a5de97c520 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:16:21.612941 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-e4d9eae2-a8a9-4a2e-bea9-a0a5de97c520 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.067813 Apr 20 18:16:21.613478 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 24/49] 10.222.0.22 () {60 vars in 1184 bytes} [Tue Apr 20 18:16:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:16:21.623374 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-87fb5ae5-4f90-44ff-89ca-797eb22cae34 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:21.645913 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-87fb5ae5-4f90-44ff-89ca-797eb22cae34 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026363 Apr 20 18:16:21.646510 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 26/50] 10.222.0.22 () {60 vars in 1201 bytes} [Tue Apr 20 18:16:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:16:21.656692 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:21.678364 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025472 Apr 20 18:16:21.678965 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 25/51] 10.222.0.22 () {60 vars in 1201 bytes} [Tue Apr 20 18:16:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:16:21.689179 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-bbf023c5-6ea8-405a-889d-dd4ed81dbb87 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:21.701973 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.wsgi [None req-bbf023c5-6ea8-405a-889d-dd4ed81dbb87 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 18:16:21.702630 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-bbf023c5-6ea8-405a-889d-dd4ed81dbb87 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:16:21.704014 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-bbf023c5-6ea8-405a-889d-dd4ed81dbb87 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018631 Apr 20 18:16:21.704534 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 27/52] 10.222.0.22 () {60 vars in 1184 bytes} [Tue Apr 20 18:16:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:16:23.263636 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:23.264710 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Apr 20 18:16:23.265148 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 26/53] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:23.445201 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-27e04677-e6e8-4ed6-9c66-2a2169297b7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:16:23.469712 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-27e04677-e6e8-4ed6-9c66-2a2169297b7a admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.077535 Apr 20 18:16:23.470233 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 28/54] 10.222.0.22 () {64 vars in 1226 bytes} [Tue Apr 20 18:16:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:16:25.027923 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:25.028974 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Apr 20 18:16:25.029446 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 27/55] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:25.210064 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-c281c181-26ed-42d3-bf87-5075b4f3e175 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:16:25.234064 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-c281c181-26ed-42d3-bf87-5075b4f3e175 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.079191 Apr 20 18:16:25.234715 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 29/56] 10.222.0.22 () {64 vars in 1226 bytes} [Tue Apr 20 18:16:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:16:26.791133 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:26.792218 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Apr 20 18:16:26.792636 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 28/57] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:26.975221 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-852363e7-14b1-4131-a10b-e72e1a10ef7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:16:27.001943 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-852363e7-14b1-4131-a10b-e72e1a10ef7e admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.080520 Apr 20 18:16:27.002469 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 30/58] 10.222.0.22 () {64 vars in 1226 bytes} [Tue Apr 20 18:16:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:16:28.558320 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:28.559441 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Apr 20 18:16:28.559879 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 29/59] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:28.740642 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-932372bd-fb79-4f66-98c6-3b3204b60cb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:16:28.764727 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-932372bd-fb79-4f66-98c6-3b3204b60cb1 admin admin] 10.222.0.22 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.078575 Apr 20 18:16:28.765267 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 31/60] 10.222.0.22 () {64 vars in 1226 bytes} [Tue Apr 20 18:16:28 2021] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:16:30.328657 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:30.329719 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Apr 20 18:16:30.330155 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 30/61] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:16:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:16:30.510719 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-7c0efdb9-c8b1-488b-9c4a-ba442f026bd2 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:16:30.539012 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-7c0efdb9-c8b1-488b-9c4a-ba442f026bd2 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081943 Apr 20 18:16:30.539531 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 32/62] 10.222.0.22 () {60 vars in 1193 bytes} [Tue Apr 20 18:16:30 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:17:21.505715 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:17:21.506798 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-d9f554e3-98db-480e-87ef-dda0e7d851dc admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Apr 20 18:17:21.507233 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 31/63] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:17:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:17:21.690201 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:17:21.718317 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] 10.222.0.22 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081944 Apr 20 18:17:21.718898 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 33/64] 10.222.0.22 () {60 vars in 1193 bytes} [Tue Apr 20 18:17:21 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:18:46.413906 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-2c645f20-4aa2-4d8f-9b53-76d8a533ef91 tempest-verify_tempest_config-535062692 tempest-verify_tempest_config-535062692-project] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:18:46.416024 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-2c645f20-4aa2-4d8f-9b53-76d8a533ef91 tempest-verify_tempest_config-535062692 tempest-verify_tempest_config-535062692-project] 10.222.0.22 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.124002 Apr 20 18:18:46.416684 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 32/65] 10.222.0.22 () {58 vars in 1124 bytes} [Tue Apr 20 18:18:46 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:20:21.253414 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:21.254491 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Apr 20 18:20:21.255003 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 34/66] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:20:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:20:21.510622 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-0694e02a-1d09-4f7e-bc55-eceafa3c9be1 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:21.511988 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:20:21.511988 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:20:21.514241 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-0694e02a-1d09-4f7e-bc55-eceafa3c9be1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:21.514765 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-0694e02a-1d09-4f7e-bc55-eceafa3c9be1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:21.515611 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-0694e02a-1d09-4f7e-bc55-eceafa3c9be1 admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:21.516088 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-0694e02a-1d09-4f7e-bc55-eceafa3c9be1 admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:21.548672 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-0694e02a-1d09-4f7e-bc55-eceafa3c9be1 admin admin] 10.222.0.22 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.166103 Apr 20 18:20:21.549267 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 33/67] 10.222.0.22 () {60 vars in 1184 bytes} [Tue Apr 20 18:20:21 2021] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:20:23.114648 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:23.115700 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Apr 20 18:20:23.116127 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 35/68] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:20:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:20:23.298156 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-135ae1c6-1914-4853-b9c2-4f78778632a3 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:23.299497 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:20:23.299497 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:20:23.301250 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-135ae1c6-1914-4853-b9c2-4f78778632a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:23.301785 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-135ae1c6-1914-4853-b9c2-4f78778632a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:23.302667 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-135ae1c6-1914-4853-b9c2-4f78778632a3 admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:23.303150 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-135ae1c6-1914-4853-b9c2-4f78778632a3 admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:23.328175 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-135ae1c6-1914-4853-b9c2-4f78778632a3 admin admin] 10.222.0.22 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.084193 Apr 20 18:20:23.328701 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 34/69] 10.222.0.22 () {60 vars in 1184 bytes} [Tue Apr 20 18:20:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:20:35.328458 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:35.329527 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Apr 20 18:20:35.330121 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 36/70] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:20:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:20:35.514490 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-64c2ba38-6399-46ad-bc12-d828f7b6caea admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:35.515818 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:20:35.515818 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:20:35.517442 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-64c2ba38-6399-46ad-bc12-d828f7b6caea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:35.517938 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-64c2ba38-6399-46ad-bc12-d828f7b6caea admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:35.518814 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-64c2ba38-6399-46ad-bc12-d828f7b6caea admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:35.519298 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-64c2ba38-6399-46ad-bc12-d828f7b6caea admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:35.553220 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-64c2ba38-6399-46ad-bc12-d828f7b6caea admin admin] 10.222.0.22 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.093296 Apr 20 18:20:35.553748 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 35/71] 10.222.0.22 () {60 vars in 1184 bytes} [Tue Apr 20 18:20:35 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:20:37.120329 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] Calling method '>' {{(pid=85682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:37.121992 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-74520d06-5536-40ae-b838-ba95dc940f44 admin admin] 10.222.0.22 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Apr 20 18:20:37.122422 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85682|app: 0|req: 37/72] 10.222.0.22 () {56 vars in 1065 bytes} [Tue Apr 20 18:20:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:20:37.304412 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG nova.api.openstack.wsgi [None req-927bf08f-f592-4e5c-948a-b349440e2737 admin admin] Calling method '>' {{(pid=85681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:20:37.305774 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:20:37.305774 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: warnings.warn(msg) Apr 20 18:20:37.307453 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-927bf08f-f592-4e5c-948a-b349440e2737 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:37.307944 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-927bf08f-f592-4e5c-948a-b349440e2737 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:37.308833 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-927bf08f-f592-4e5c-948a-b349440e2737 admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:20:37.309265 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: DEBUG oslo_concurrency.lockutils [None req-927bf08f-f592-4e5c-948a-b349440e2737 admin admin] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85681) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:20:37.336460 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: INFO nova.api.openstack.requestlog [None req-927bf08f-f592-4e5c-948a-b349440e2737 admin admin] 10.222.0.22 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.086226 Apr 20 18:20:37.336982 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: [pid: 85681|app: 0|req: 36/73] 10.222.0.22 () {60 vars in 1184 bytes} [Tue Apr 20 18:20:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:21:35.878845 dv-cinder-786930-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 20 18:21:35.879669 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: Tue Apr 20 18:21:35 2021 - graceful shutdown triggered... Apr 20 18:21:35.880116 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: Gracefully killing worker 1 (pid: 85681)... Apr 20 18:21:35.880323 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: Gracefully killing worker 2 (pid: 85682)... Apr 20 18:21:36.880793 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: worker 1 buried after 1 seconds Apr 20 18:21:36.880793 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: worker 2 buried after 1 seconds Apr 20 18:21:36.881342 dv-cinder-786930-2-iscsi devstack@n-api.service[85680]: goodbye to uWSGI. Apr 20 18:21:36.882500 dv-cinder-786930-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 20 18:21:36.884149 dv-cinder-786930-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 18:21:36.892171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 18:21:36 2021] *** Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: nodename: dv-cinder-786930-2-iscsi Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: machine: x86_64 Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: clock source: unix Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: pcre jit disabled Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: detected number of CPU cores: 4 Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: current working directory: / Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: detected binary path: /usr/bin/uwsgi-core Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: dropping root privileges as early as possible Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: your processes number limit is 47843 Apr 20 18:21:36.894124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: your memory page size is 4096 bytes Apr 20 18:21:36.895330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: detected max file descriptor number: 2048 Apr 20 18:21:36.895330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: lock engine: pthread robust mutexes Apr 20 18:21:36.895330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: thunder lock: enabled Apr 20 18:21:36.895330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 18:21:36.895330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: dropping root privileges after socket binding Apr 20 18:21:36.895330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 18:21:36.940991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Python main interpreter initialized at 0x5635c123a9c0 Apr 20 18:21:36.940991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: dropping root privileges after plugin initialization Apr 20 18:21:36.940991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: python threads support enabled Apr 20 18:21:36.940991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: your server socket listen backlog is limited to 100 connections Apr 20 18:21:36.940991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: your mercy for graceful operations on workers is 90 seconds Apr 20 18:21:36.941422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 18:21:36.941422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: *** Operational MODE: preforking *** Apr 20 18:21:36.941663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: dropping root privileges after application loading Apr 20 18:21:36.941663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: *** uWSGI is running in multiple interpreter mode *** Apr 20 18:21:36.941663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: spawned uWSGI master process (pid: 100567) Apr 20 18:21:36.943388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: spawned uWSGI worker 1 (pid: 100569, cores: 1) Apr 20 18:21:36.943388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: spawned uWSGI worker 2 (pid: 100570, cores: 1) Apr 20 18:21:36.943388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 18:21:36.941815 dv-cinder-786930-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 18:21:42.165630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:21:42.166136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:21:42.167531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:21:42.168015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:21:42.168316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:21:42.169145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.169524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.169893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.170260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.170676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.171039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.171410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.171784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.172167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.172471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.172830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.173210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786930-2-iscsi {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.173589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.173943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.174300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.174711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.175064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.175440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.175793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.176426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.176783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.177135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.177489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.177886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.178247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.178650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.179027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.179380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.179766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.180117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.180490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786930-2-iscsi {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.180861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.181218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.181577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.182100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.182485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.182834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.183205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.183613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.183968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.184352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.184723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.185098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.185482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.185822 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.186172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.186551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.186924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.187275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.187623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.187912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.188267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.188639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.189007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.189361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.189658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.189949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.190321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.190728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.191088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.191438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.191793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.192144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.192492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.192841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.193189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.193537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.193911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.194276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.194686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.195038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.195411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.195892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.22 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.196182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.22 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.196533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.196930 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.197300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.197650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.198016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.198387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.198767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.199610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.199997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.200366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.201116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.201116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.201431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.202641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.202641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.202641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.202641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.202933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.203286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.203626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.203971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.204318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.204666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.205012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.205359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.205704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.206053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.206399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.207235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.207614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.207990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.208341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.208691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.209041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.209392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.209759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.210108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.210489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.210854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.211201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.211550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.211918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.212272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.212623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.212990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.213340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.213683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.214057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.214405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.214827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.215681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.216031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.216415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.216690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.217032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.217374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.217716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.218083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.218453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.219197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.219551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.220080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.220253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.220617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.221000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.221110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:21:42.221348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:21:42.221456 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.222072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.222072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.222546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.222826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.222926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:21:42.223184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.223376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:21:42.223537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.223650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:21:42.223908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.224077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.224232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.224424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.224584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.224795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.224959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.225161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.225326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.225549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.225707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.225910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.226065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.226228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.226379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.226613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.226772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.226975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.227141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.227286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.227436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.227585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.227746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.227952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786930-2-iscsi {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.228109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.228343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.228502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.228646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.228799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.228983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.229143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.229351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.229526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.229673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.229838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.230061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.230226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.230400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.230576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.230775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.231072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.231245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.231397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.231547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.231754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.231922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.232083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.232226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.232448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.232607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.232800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.232962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.233156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.233324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.233514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.233676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.233828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.234058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.234221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.234366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.234552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.234713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.234866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.235010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786930-2-iscsi {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.235154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.235296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.235500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.235620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.235865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.235989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.236255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.236369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.236589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.236694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.236975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.237154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.237322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.237427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.237674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.237787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.238025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.238130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.238364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.238570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.238793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.238923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.239165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.239807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.239925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.240048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.240255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.240389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.240504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.240615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.240732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.240845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.240989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.241140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.241247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.241354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.241454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.241552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.241733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.241839 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.242082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.242186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.242453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.242580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.242849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.243279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.243461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.243575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.243755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.243869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.244130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.244261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.244495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.244624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.244845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.244969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.245196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.245314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.245548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.245657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.245903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.246009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.246290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.246407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.246683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.247032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.247385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.247728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.250512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.250715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.250715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.251003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.251157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.251309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.251460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.251603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.251745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.251898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.252016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.252119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.252225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.252326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.252432 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.252533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.252649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.252755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.22 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.252857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.252964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.22 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.253071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.253177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.253285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.253285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.253520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.253520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.253715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.253715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.253911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.253911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.254110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.254110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.254562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.254562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.254762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.254862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.254970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.255071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.255187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.255297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.255297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.255297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.255577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.255901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.256255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.256414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.256628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.256758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.256977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.257102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.257330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.257455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.258286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.258436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.258592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.258814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.258945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.259059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.259172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.259291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.259412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.259533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.259654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.259773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.259886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.259991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.260075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.260188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.260272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.260433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.260584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.260798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.261118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.261236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.261487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.261592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.262438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.262656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.262831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.262999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.263152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.263304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.263463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.263629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.263793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.263944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.264052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.264155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.264535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.264725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.264725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.265055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.265215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.265366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.265524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.265687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.265863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.266030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.266225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.266382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.266511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.266591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.266682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.267013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.267137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.267353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.267483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.267705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.267834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.268338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.268479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.268479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.268711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.268928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.269051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.269165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.269315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.269440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.269668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.269801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.270012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.270125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.270351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.270567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.270691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.271039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.271407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.271571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.271777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.272129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.272481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.272828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.273178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.273337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:21:42.275203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.275362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.275362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.275667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.275798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.275923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.275923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.276976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.277084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.277199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.277336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.277945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.278034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.278109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.278246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.278338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.278412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.279214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.279404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.279404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.279709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.279861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.280991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.281099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.281214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.281317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.281431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.281637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.281995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.282165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.282386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.282601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.282808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.282970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.283164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.283332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.283522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.283690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.283850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.283999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.284210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.284378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.284574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.285235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.285235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.285543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.285693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.285842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.285990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.286150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.286298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.286448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.286645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.286807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.286964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.287132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.287292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.289117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.289311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.289477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.289642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.289805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.289961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.290123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.290291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.290509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.290666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.290926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.291097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.291253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.291410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.291567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.291731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.291881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.292948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.293901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.294786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.295426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.295558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.295669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.295772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.295872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.296068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.296182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.296422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.296536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.296800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.296906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.297149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.297295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.297494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.297607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.297851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.297963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.298205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.298325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.298706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.299157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.299566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.299983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.300134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.300856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.301913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.302026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.302145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.302270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.302389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.302851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.302984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.303888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.304112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.304245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.304468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.304592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.304848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.305112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.305235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.305697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.305836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.305950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.306076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.306190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.306309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.306637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.306805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.306968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.307119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.307275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.307435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.307592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.307798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.307958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.308161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.308328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.308557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.308721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.308978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.309144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.309302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.309461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.309660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.309826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.309983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.310252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.310417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.310635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.310795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.310967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.311207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.311365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.311515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.311678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.311834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.311992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.312150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.312315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.312469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.312627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.312778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.312936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.313085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.313274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.313440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.313599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.313751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.314034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.314199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.314352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.314534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.314739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.314905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.315163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.315345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.315498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.315677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.315992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.316150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.316306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.316457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.316613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.316770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.316928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.317079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.317233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.317389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.317549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.317711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.317870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.318065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.318224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.318436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.318628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.318920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.319081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.319300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.319466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.319689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.319856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.320078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.320255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.320535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.320692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.320848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.321013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.321186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.321412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.321611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.321765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.322163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.322400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.322612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.323966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.324923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.325749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.325957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.326318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.326513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.326673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.326834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.326994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.327156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.327308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.327463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.327624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.327624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.327922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.328987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.329282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.329443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.329642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.329810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.330007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.330175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.330327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.330505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.330778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.331257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.331451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.331702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.331865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.332019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.332234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.332400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.332571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.332722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.332938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.333098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.333299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.333459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.333664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.333830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.334030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.334189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.334396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.334990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.335227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.336494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.336494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.336494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.336882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.337831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.338066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.338207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.338361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.338500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.338718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.340556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.340754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.340754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.340957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.341066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.341066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.341066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.342735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.343883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.343996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.343996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.344147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.344227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.344588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.344674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.344749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.344831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.345316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.345846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.346021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.346391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.346805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.347431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.347554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.347742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.347869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.348116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.348250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.348477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.348609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.348833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.349984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.350233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.350349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.350894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.351255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.351388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.351613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.351720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.352029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.352180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.352380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.352504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.352738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.352868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.353097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.353216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.353453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.353571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.353804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.353931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.354164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.354281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.354561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.354716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.355244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.355634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.355996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.356505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.356653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.356771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.356893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.357016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.357134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.357352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.357461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.357707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.357827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.358066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.358180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.358430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.358570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.358850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.358973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.359218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.359322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.359579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.359688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.359936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.360054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.360284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.360458 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.360612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.360782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.360965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.361148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.361304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.361462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.361615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.361766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.361981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.362276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.362475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.362661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.362827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.362989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.363150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.363301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.363467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.363618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.363774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.363934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.364097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.364254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.364412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.364562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.364717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.364874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.365032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.365183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.365333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.365491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.365642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.366441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.366624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.366742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.366855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.367918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.368020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.368182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.368356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.368534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.368710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.368887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.369072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.369242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.369442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.369592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.369802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.369944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.370152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.370295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.370545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.370692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.370911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.371058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.371305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.371437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.371658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.371781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.372006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.372132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.372333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.372463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.372683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.372953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.373123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.373312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.373479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.373630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.373787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.373985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.374144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.374394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.374946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.375042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.375156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.375418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.375535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.375766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.375872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.376120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.376225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.376478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.376627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.376837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.376996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.377191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.377318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.377538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.377730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.377896 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.378053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.378221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.378394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.378670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.379035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.379398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.379760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.379942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.380106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.380302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.380470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.380676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.380846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.381078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.381241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.381438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.381565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.381795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.381919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.382159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.382443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.382681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.383973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.384207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.384380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.384564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.384694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.384920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.385044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.385274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.385421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.385621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.385759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.386017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.386161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.386285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.386399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.387687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.387826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.387943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.388832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.389016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.389193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.389366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.389545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.389706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.389864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.390033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.390191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.390398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.390665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.390829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.390990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.391151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.391312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.391463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.391668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.391830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.391991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.392150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.392355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.392516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.392715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.392924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.393069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.393259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.393413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.393617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.393769 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.393976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.394128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.394352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.394716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.394920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.395089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.395245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.395396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.395547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.395789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.395970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.396135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.396303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.396505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.396657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.396777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.396888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.397098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.397389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.397495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.397751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.397866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.398129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.398241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.398549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.398921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.399286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.399428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.399757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.400134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.400494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.400867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.401681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.401831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.401947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.402060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.402060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.402325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.403949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.404125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.404269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.404460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.404651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.404829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.405004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.405176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.405353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.405514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.405680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.405846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.406002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.406171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.406339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.406866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.407085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.407244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.407495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.407664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.407824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.407977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.408147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.408307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.408460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.408611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.408762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.408920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.409081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.409237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.409356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.409462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.409566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.409676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.410161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.410277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.410563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.410701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.411420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.411551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.411657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.411758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.411866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.411969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.412993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.413222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.413332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.413595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.413710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.413945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.414052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.414295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.414404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.414672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.414933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.415108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.415261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.415420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.415611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.415808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.416023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.416190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.416360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.416513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.416672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.417051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.417209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.417387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.417638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.417812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.418888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.419187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.419345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.419503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.419655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.419806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.419955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.420978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.421180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.421320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.421546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.421667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.421918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.422027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.422294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.422410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.422939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.423330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.423535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.423699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.423863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.424056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.424216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.424410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.424585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.424752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.424918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.425061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.425233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.425387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.425561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.425715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.425882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.426049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.426204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.426379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.426662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.427050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.427220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.427372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.427521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.427679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.427829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.428987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.429188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.429302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.429401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.429647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.429755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.430010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.430117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.430370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.430568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.430765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.431122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.431312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.431477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.431683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.431864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.432021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.432175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.432374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.432546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.432736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.432907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.433068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.433229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.433430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.433617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.433854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.434017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.434216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.434386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.434718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.434903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.435074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.435228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.435388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.435540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.435691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.435854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.436963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.437217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.437390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.437554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.437709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.437869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.438029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.438188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.438347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.438645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.439007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.439338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.439522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.439717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.439873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.440080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.440252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.440412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.440584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.440840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.441001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.441161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.441325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.441635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.441814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.441968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.442126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.442351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.442546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.442761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.443135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.443297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.443507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.443677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.443877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.444046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.444255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.444439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.444680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.444852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.445005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.445157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.445356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.445523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.445679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.445887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.446048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.446253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.446420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.446726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.447161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.447364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.447521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.447768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.447932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.448091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.448294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.448612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.448778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.449025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.449723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.449958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.450179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.450341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.450581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.450745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.451079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.451240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.451403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.451562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.451714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.451866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.452024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.452294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.452464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.452678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.452841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.453001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.453165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.453329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.453482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.453650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.453803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.454102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.454279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.454434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.454664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.454835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.454995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.455157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.455318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.455471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.455680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.455855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.456984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.457136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.457312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.457529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.457693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.457946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.458120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.458282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.458436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.458861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.459234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.459406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.459575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.459750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.460040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.460218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.460373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.460538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.460692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.460902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.461082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.461960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.462131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.462306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.462501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.462685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.462846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.462846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.463153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.463314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.463474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.463635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.463800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.463964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.464122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.464287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.464451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.464611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.464817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.465473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.465639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.465794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.465953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.466106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.466264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.466417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.466609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100570) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:21:42.466781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.467014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.467366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.467749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.468092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.468443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.468803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.469254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.469525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.469881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.470238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.470615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.471019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.471306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.471661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.472243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.472368 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.474066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.474856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.474856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.475183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.475526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.475894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.476256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.476626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.476989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.477349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.477716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.478105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.478512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.478847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.479352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.479717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.480078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.480480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.480836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.481219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.481614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.481997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.482394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.482775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.483131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.483483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.483841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.484239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.484631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.484997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.485369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.485747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.486114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.487071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.487071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.487358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.487479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.487890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.488310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.488624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.489087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.490594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.490594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.490594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.490594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.490594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.490993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.491245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.491635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.491976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.492548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.492911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.493287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.493642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.494022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.494399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.494796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.495154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.495536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.495893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.496787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.497144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.497500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.497865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.498224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.498713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.499194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.499378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.500195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.500195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.500520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.500684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.501007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.501808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.501808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.502288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.502444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.502758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.503115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.503466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.503807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.504694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.504694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.505121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.505416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.506576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.506576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.506576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:21:42.506576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100569) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:21:42.509503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100570) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.543626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100569) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.775435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.context [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fed6a0e7-292a-432d-90d4-b7835fd301db(cell1) {{(pid=100570) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:21:42.780995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:21:42.782876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:21:42.783754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:21:42.786169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:21:42.812208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100570) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.814829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100570) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.815199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.context [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fed6a0e7-292a-432d-90d4-b7835fd301db(cell1) {{(pid=100569) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:21:42.820751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:21:42.822670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:21:42.823569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:21:42.826376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:21:42.843792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100570) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.852148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100569) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.853059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100569) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.883332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_db.sqlalchemy.engines [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100569) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:21:42.927419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:21:42.927419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: from cryptography.utils import int_from_bytes Apr 20 18:21:42.927801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:21:42.927801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: from cryptography.utils import int_from_bytes Apr 20 18:21:42.965320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:21:42.965320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: from cryptography.utils import int_from_bytes Apr 20 18:21:42.965704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:21:42.965704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: from cryptography.utils import int_from_bytes Apr 20 18:21:43.005570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading Gnome Apr 20 18:21:43.026161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading Google Apr 20 18:21:43.029735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading Windows (alt) Apr 20 18:21:43.034654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading file Apr 20 18:21:43.036003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading keyczar Apr 20 18:21:43.036450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading multi Apr 20 18:21:43.037322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Loading pyfs Apr 20 18:21:43.044552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading Gnome Apr 20 18:21:43.065729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading Google Apr 20 18:21:43.069188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading Windows (alt) Apr 20 18:21:43.074208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading file Apr 20 18:21:43.075340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading keyczar Apr 20 18:21:43.075799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading multi Apr 20 18:21:43.076684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO keyring.backend [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Loading pyfs Apr 20 18:21:43.322080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:21:43.329255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:21:43.360197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:21:43.367552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:21:43.669342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:21:43.675121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-25d6cb03-4213-4fc1-ada6-dcd3a7779a21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:21:43.680884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635c123a9c0 pid: 100570 (default app) Apr 20 18:21:43.703352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:21:43.709107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WARNING keystonemiddleware.auth_token [None req-070168b3-2a5f-4369-9226-c7448e084574 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:21:43.715382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635c123a9c0 pid: 100569 (default app) Apr 20 18:22:20.720709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6daa2ddd-ea8e-42a6-964c-c34956124cc6 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Action: 'create', calling method: .version_select at 0x7f1a1d4002f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-461305805", "metadata": {"Type": "work"}}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:20.964195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-32fd2d1d-edce-4997-8374-291a5b1aee45 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Action: 'create', calling method: .version_select at 0x7f1a1d3fe2f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2124597885"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:22.277675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6daa2ddd-ea8e-42a6-964c-c34956124cc6 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.755853 Apr 20 18:22:22.278442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 1/1] 10.222.0.22 () {60 vars in 1146 bytes} [Tue Apr 20 18:22:19 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2759 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 20 18:22:22.292892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f486051-b827-46b0-9a36-f19e8dd64fea tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d400b70>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:22.474489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-32fd2d1d-edce-4997-8374-291a5b1aee45 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.623802 Apr 20 18:22:22.475287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 1/2] 10.222.0.22 () {60 vars in 1145 bytes} [Tue Apr 20 18:22:19 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2627 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 20 18:22:22.489432 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce1d0831-62cf-4bcd-9b06-573dfe6338e9 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d3feb70>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:22.555067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f486051-b827-46b0-9a36-f19e8dd64fea tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 352 microversion: 2.1 time: 0.266903 Apr 20 18:22:22.556238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 2/3] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:22 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 352 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:22.729169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ce1d0831-62cf-4bcd-9b06-573dfe6338e9 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 200 len: 345 microversion: 2.1 time: 0.243995 Apr 20 18:22:22.735300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 2/4] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:22 2021] GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:23.568952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-063c7965-5f8c-4cbc-95b4-479d2538c418 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d3c2d08>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:23.678627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-063c7965-5f8c-4cbc-95b4-479d2538c418 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 352 microversion: 2.1 time: 0.113456 Apr 20 18:22:23.684110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 3/5] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:23 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:23.746025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e215731e-c58e-4cb4-ada3-94d1978847e8 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d3b9d08>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:23.890247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e215731e-c58e-4cb4-ada3-94d1978847e8 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 200 len: 346 microversion: 2.1 time: 0.150478 Apr 20 18:22:23.891009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 3/6] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:23 2021] GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:23.907722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0b9efe6c-6bf4-4f84-9803-d10869792cf0 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Action: 'create', calling method: .version_select at 0x7f1a1d3c2ae8>, body: {"snapshot": {"volume_id": "5602a73a-c376-49aa-9a5d-4f20af733732", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1640949352"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:24.301253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0b9efe6c-6bf4-4f84-9803-d10869792cf0 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.401394 Apr 20 18:22:24.301881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 4/7] 10.222.0.22 () {60 vars in 1152 bytes} [Tue Apr 20 18:22:23 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:24.312737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0035d69a-d38b-4e65-8951-22a4d723c0aa tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d3b9ae8>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:24.394989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0035d69a-d38b-4e65-8951-22a4d723c0aa tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 200 len: 287 microversion: 2.1 time: 0.086045 Apr 20 18:22:24.396264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 4/8] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 18:22:24 2021] GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:24.416717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cc98e4fd-0c6b-443e-bbb5-15fdb3a0b5e3 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d400bf8>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:24.466895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cc98e4fd-0c6b-443e-bbb5-15fdb3a0b5e3 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059730 Apr 20 18:22:24.467715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 5/9] 10.222.0.22 () {58 vars in 1130 bytes} [Tue Apr 20 18:22:24 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:24.480188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6c6e4840-62f2-4f32-96e2-a196f4e6ee74 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d3b99d8>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:24.547380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6c6e4840-62f2-4f32-96e2-a196f4e6ee74 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 200 len: 287 microversion: 2.1 time: 0.071628 Apr 20 18:22:24.548538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 5/10] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 18:22:24 2021] GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:24.691733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-52400053-4d24-4eb6-a7c7-7f35d1471ab8 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d369950>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:24.914067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-52400053-4d24-4eb6-a7c7-7f35d1471ab8 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 353 microversion: 2.1 time: 0.226111 Apr 20 18:22:24.914992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 6/11] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:24 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:24.926840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3fb5656a-4037-460f-929e-5940da640db6 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d36e048>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:25.108216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3fb5656a-4037-460f-929e-5940da640db6 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 353 microversion: 2.1 time: 0.185175 Apr 20 18:22:25.109335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 6/12] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:24 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:25.131817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-22109bc0-09d0-4fc8-9f9d-c6017c43d0ed tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d3c2ea0>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:25.285680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-22109bc0-09d0-4fc8-9f9d-c6017c43d0ed tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "DELETE /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 202 len: 0 microversion: 2.1 time: 0.157648 Apr 20 18:22:25.296066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1233f187-0c2c-4627-b4c2-971bf1359f98 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d3b9c80>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:25.296908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 7/13] 10.222.0.22 () {58 vars in 1238 bytes} [Tue Apr 20 18:22:25 2021] DELETE /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:22:25.471695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1233f187-0c2c-4627-b4c2-971bf1359f98 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 352 microversion: 2.1 time: 0.180170 Apr 20 18:22:25.486098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 7/14] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:25 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 352 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:25.563962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d9dd0e8f-b4aa-4005-b575-e589fb9ad412 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d3c2bf8>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:25.636104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d9dd0e8f-b4aa-4005-b575-e589fb9ad412 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 200 len: 287 microversion: 2.1 time: 0.076578 Apr 20 18:22:25.637820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 8/15] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 18:22:25 2021] GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:26.486031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-77412172-93bb-439f-ae4a-c5490db8d553 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d3b9ae8>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:26.664093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c66c24d5-ff89-452c-8e4b-7b4f457c0dc8 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d4002f0>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:26.782920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-77412172-93bb-439f-ae4a-c5490db8d553 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 352 microversion: 2.1 time: 0.301114 Apr 20 18:22:26.784000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 8/16] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:26 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 352 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:26.801120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c66c24d5-ff89-452c-8e4b-7b4f457c0dc8 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 200 len: 287 microversion: 2.1 time: 0.151706 Apr 20 18:22:26.812267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 9/17] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 18:22:26 2021] GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:27.800377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d83309e-6d4f-423d-89ef-2ed8cf5c7260 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d400bf8>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:28.186777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d83309e-6d4f-423d-89ef-2ed8cf5c7260 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 200 len: 352 microversion: 2.1 time: 0.389040 Apr 20 18:22:28.188926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 10/18] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:27 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 352 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:28.198798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5ad9d6bf-5b49-4238-bc59-a873a20e4a9a tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d3c29d8>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:28.313884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-293763369", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "f6c31916-db3f-4eef-ba20-4a218aa43e3d"}]}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:28.323262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5ad9d6bf-5b49-4238-bc59-a873a20e4a9a tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 200 len: 288 microversion: 2.1 time: 0.131172 Apr 20 18:22:28.324046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 11/19] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 18:22:28 2021] GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 288 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:28.448653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1583465492", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "0f9574a1-d5d5-414a-bc7b-242ef66e05a4"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:28.535079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] validate_networks() for [('f6c31916-db3f-4eef-ba20-4a218aa43e3d', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:22:28.679244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] validate_networks() for [('0f9574a1-d5d5-414a-bc7b-242ef66e05a4', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:22:30.070989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:22:30.072062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:22:30.072823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:22:30.074250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:22:30.074958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:22:30.088409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:30.089771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:30.090885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:30.091589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:30.118962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Getting quotas for project 812f10aeffbd4431814b5d6f985d46b2. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:30.125190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Getting quotas for user 211d92fa565948108ee28b5da019429c and project 812f10aeffbd4431814b5d6f985d46b2. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:30.141938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:22:30.147172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:22:30.250937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1201082d-a1ba-4ce3-afb3-228c54f83032 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925027 Apr 20 18:22:30.258910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 12/20] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:22:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:22:30.273238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8eccdcb6-8dd3-4c9f-94ca-00092b1f3c5b tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d369c80>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:30.424255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8eccdcb6-8dd3-4c9f-94ca-00092b1f3c5b tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "DELETE /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 202 len: 0 microversion: 2.1 time: 0.162091 Apr 20 18:22:30.425317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 13/21] 10.222.0.22 () {58 vars in 1244 bytes} [Tue Apr 20 18:22:30 2021] DELETE /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:22:30.435131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7849a624-a9ea-43ad-8932-cdd3c3981604 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Calling method '.version_select at 0x7f1a1d1ea8c8>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:30.586702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-7849a624-a9ea-43ad-8932-cdd3c3981604 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] HTTP exception thrown: Volume ea7f3e5b-4468-4dbd-8739-c278344c9585 could not be found. Apr 20 18:22:30.587568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7849a624-a9ea-43ad-8932-cdd3c3981604 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] Returning 404 to user: Volume ea7f3e5b-4468-4dbd-8739-c278344c9585 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:30.588674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7849a624-a9ea-43ad-8932-cdd3c3981604 tempest-VolumesGetTestJSON-212457323 tempest-VolumesGetTestJSON-212457323-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585" status: 404 len: 109 microversion: 2.1 time: 0.158406 Apr 20 18:22:30.589691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 14/22] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:30 2021] GET /compute/v2.1/os-volumes/ea7f3e5b-4468-4dbd-8739-c278344c9585 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:30.894690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-957977877", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cda7ac9-7880-42f9-83fa-9a04d660385f"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:30.974741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] validate_networks() for [('8cda7ac9-7880-42f9-83fa-9a04d660385f', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:22:31.317182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:22:31.317664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:22:31.318155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:22:31.318650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:22:31.319255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:22:31.341230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:31.343337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:31.344239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:31.344721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:31.405144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:31.422849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for user d0c2f29521f34fc0bf8356872818be71 and project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:31.452138 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Going to run 1 instances... {{(pid=100569) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:22:31.462233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100569) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:22:31.739442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9603f768-bf10-4d27-892e-e3327a619e38 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.964640 Apr 20 18:22:31.745303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 9/23] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:22:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 3972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:22:31.758842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f05d1f7-a42f-466e-9f64-860fd0d2d38f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:31.759510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f05d1f7-a42f-466e-9f64-860fd0d2d38f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:32.327836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:22:32.328338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:22:32.328834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:22:32.329405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:22:32.329873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:22:32.353566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:32.354356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:32.355410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:32.358046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:32.436006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Getting quotas for project 955c260aa1614be9af3114cf4e8f268a. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:32.451428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Getting quotas for user e075ca5d3ffd456299f20129025c517c and project 955c260aa1614be9af3114cf4e8f268a. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:32.478742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:22:32.485825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:22:32.498424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f05d1f7-a42f-466e-9f64-860fd0d2d38f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:32.548942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f05d1f7-a42f-466e-9f64-860fd0d2d38f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1215 microversion: 2.1 time: 0.795092 Apr 20 18:22:32.550597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 10/24] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:31 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1215 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:32.557061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ea622b3-7b1a-42c1-9962-6dc0beaa0c7e tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d1e08c8>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:32.614763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d5f200d4-4172-4e2d-91d2-4c47b5ca5d08 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.020936 Apr 20 18:22:32.619414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 15/25] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:22:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:22:32.629619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-63f17296-37b2-466b-9b10-d7a4b975c829 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:32.630652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-63f17296-37b2-466b-9b10-d7a4b975c829 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:32.666820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-0ea622b3-7b1a-42c1-9962-6dc0beaa0c7e tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] HTTP exception thrown: Snapshot 3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 could not be found. Apr 20 18:22:32.667881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ea622b3-7b1a-42c1-9962-6dc0beaa0c7e tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Returning 404 to user: Snapshot 3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:32.668809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ea622b3-7b1a-42c1-9962-6dc0beaa0c7e tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5" status: 404 len: 111 microversion: 2.1 time: 0.116055 Apr 20 18:22:32.669843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 11/26] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 18:22:32 2021] GET /compute/v2.1/os-snapshots/3ad3ba0c-5e91-4e5b-97dd-a13075ae30b5 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:32.681400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2f5a35ef-895f-44fc-9631-a12e1817d256 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:32.686600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2f5a35ef-895f-44fc-9631-a12e1817d256 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:32.955895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-63f17296-37b2-466b-9b10-d7a4b975c829 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:32.987177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-63f17296-37b2-466b-9b10-d7a4b975c829 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1217 microversion: 2.1 time: 0.366138 Apr 20 18:22:32.991128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 16/27] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:32 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1217 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:33.001505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-23e7fbc2-8adb-408b-93b4-a301ec4baf51 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d208f28>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:33.008972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2f5a35ef-895f-44fc-9631-a12e1817d256 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:33.032347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2f5a35ef-895f-44fc-9631-a12e1817d256 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1221 microversion: 2.1 time: 0.358084 Apr 20 18:22:33.034216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 12/28] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:32 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1221 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:33.288187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-23e7fbc2-8adb-408b-93b4-a301ec4baf51 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "DELETE /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 202 len: 0 microversion: 2.1 time: 0.295053 Apr 20 18:22:33.289402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 17/29] 10.222.0.22 () {58 vars in 1238 bytes} [Tue Apr 20 18:22:32 2021] DELETE /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:22:33.296776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1860077203", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cda7ac9-7880-42f9-83fa-9a04d660385f"}]}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:33.310931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cdb08264-36c9-44d8-84af-ec02258e5935 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1d369d08>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:33.434951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] validate_networks() for [('8cda7ac9-7880-42f9-83fa-9a04d660385f', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:22:33.529052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cdb08264-36c9-44d8-84af-ec02258e5935 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 200 len: 345 microversion: 2.1 time: 0.228652 Apr 20 18:22:33.530384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 18/30] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:33 2021] GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 345 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:33.567903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:33.569548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:33.586377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:33.589946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:33.591087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:33.591789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:34.078548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:34.097125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f3f029b0-aa26-4866-bc77-83fd5a0c46d5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1267 microversion: 2.1 time: 0.533119 Apr 20 18:22:34.102411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 19/31] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:33 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1267 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:34.115017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:34.116206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:34.126215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:34.126747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:34.127593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:34.128083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:34.846872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:34.875851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-407a60c6-2869-48dc-b26d-30a0963aa719 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1213 microversion: 2.1 time: 0.762193 Apr 20 18:22:34.877274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 20/32] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:34 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1213 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:34.890794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4eb69907-2d0c-4c2d-ae2d-b7239c5e0e55 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1c93a158>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:35.064712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-4eb69907-2d0c-4c2d-ae2d-b7239c5e0e55 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] HTTP exception thrown: Volume 5602a73a-c376-49aa-9a5d-4f20af733732 could not be found. Apr 20 18:22:35.065390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4eb69907-2d0c-4c2d-ae2d-b7239c5e0e55 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Returning 404 to user: Volume 5602a73a-c376-49aa-9a5d-4f20af733732 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:35.066273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4eb69907-2d0c-4c2d-ae2d-b7239c5e0e55 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 404 len: 109 microversion: 2.1 time: 0.181460 Apr 20 18:22:35.068062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 21/33] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:34 2021] GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:35.079119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-828dc389-d0a0-4537-a9cf-786054815e0a tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1c956620>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:35.215467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-828dc389-d0a0-4537-a9cf-786054815e0a tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] HTTP exception thrown: Volume 5602a73a-c376-49aa-9a5d-4f20af733732 could not be found. Apr 20 18:22:35.216136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-828dc389-d0a0-4537-a9cf-786054815e0a tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Returning 404 to user: Volume 5602a73a-c376-49aa-9a5d-4f20af733732 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:35.217507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-828dc389-d0a0-4537-a9cf-786054815e0a tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "DELETE /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 404 len: 109 microversion: 2.1 time: 0.143365 Apr 20 18:22:35.218271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 22/34] 10.222.0.22 () {58 vars in 1238 bytes} [Tue Apr 20 18:22:35 2021] DELETE /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:35.222999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:35.223901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:35.244810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:35.245379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:35.246247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:35.246730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:35.497433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:35.508306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b5eb2b4-ccf0-446c-8443-ed3b18e2ef3d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1273 microversion: 2.1 time: 0.289015 Apr 20 18:22:35.508945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 23/35] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:35 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:35.515160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d68a7efe-f04c-4bc3-a61a-34a01c9d9091 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Calling method '.version_select at 0x7f1a1c956730>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:35.609113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-d68a7efe-f04c-4bc3-a61a-34a01c9d9091 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] HTTP exception thrown: Volume 5602a73a-c376-49aa-9a5d-4f20af733732 could not be found. Apr 20 18:22:35.610134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d68a7efe-f04c-4bc3-a61a-34a01c9d9091 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] Returning 404 to user: Volume 5602a73a-c376-49aa-9a5d-4f20af733732 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:35.611152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d68a7efe-f04c-4bc3-a61a-34a01c9d9091 tempest-VolumesSnapshotsTestJSON-319924372 tempest-VolumesSnapshotsTestJSON-319924372-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732" status: 404 len: 109 microversion: 2.1 time: 0.100996 Apr 20 18:22:35.611841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 24/36] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:35 2021] GET /compute/v2.1/os-volumes/5602a73a-c376-49aa-9a5d-4f20af733732 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:35.895673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:35.896349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:35.925050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:35.933741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:35.937334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:35.937862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:36.099008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:22:36.099008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:22:36.099008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:22:36.099008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Image pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:22:36.099008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:22:36.120592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:36.121102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:36.121992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:36.122485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:36.157981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Getting quotas for project 955c260aa1614be9af3114cf4e8f268a. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:36.190070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Getting quotas for user e075ca5d3ffd456299f20129025c517c and project 955c260aa1614be9af3114cf4e8f268a. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:36.233118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Going to run 1 instances... {{(pid=100569) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:22:36.235624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100569) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:22:36.424624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-27621b33-3c8c-4061-8d95-25e588f3eb22 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.142122 Apr 20 18:22:36.424974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:36.425628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 13/37] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:22:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 3144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:22:36.438157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4ad90fe5-e020-4d00-8ce3-7e905dad50ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:36.439508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4ad90fe5-e020-4d00-8ce3-7e905dad50ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:36.452411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a269c16f-07c3-4f19-a332-c6acd8d5294b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1277 microversion: 2.1 time: 0.561252 Apr 20 18:22:36.454933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 25/38] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:35 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1277 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:36.530587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:36.531548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:36.549599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:36.553041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:36.554503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:36.554992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:36.714359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4ad90fe5-e020-4d00-8ce3-7e905dad50ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:36.756321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4ad90fe5-e020-4d00-8ce3-7e905dad50ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1222 microversion: 2.1 time: 0.309657 Apr 20 18:22:36.758870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 14/39] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:36 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:37.129773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:37.140197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e7a9abcf-98a6-4e23-9cd4-1da8a4ecaf67 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.615620 Apr 20 18:22:37.141264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 26/40] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:36 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:37.470634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:37.471632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:37.480336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:37.481109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:37.482176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:37.486219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:37.777943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:37.779170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:37.801318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:37.804850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:37.826383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:37.834637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:37.837959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:37.898483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6b56b8cf-b3db-4d03-96a5-a90ca0e17f19 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1277 microversion: 2.1 time: 0.431616 Apr 20 18:22:37.899511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 15/41] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:37 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1277 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:38.159131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:38.160302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:38.207462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:38.207960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:38.210956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:38.211473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:38.467497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:38.480164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e267e26f-70b7-4975-90a4-8cf090f297d8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1226 microversion: 2.1 time: 0.706070 Apr 20 18:22:38.485100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 27/42] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:37 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1226 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:38.919777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:38.920772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:38.952376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:38.953628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:38.959718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:38.963067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:39.531370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:39.549816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a1c533f3-38e1-4b93-a30b-87ace44555db tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1275 microversion: 2.1 time: 0.636064 Apr 20 18:22:39.555828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 28/43] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:38 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1275 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:39.570911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:39.577488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:39.600209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:39.615844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:39.621580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:39.622294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:40.985717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:40.998113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f8d2809e-4424-46fe-bb0f-cb969db46ef2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1274 microversion: 2.1 time: 1.438266 Apr 20 18:22:41.003666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 29/44] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:39 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1274 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:41.020152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:41.021325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:41.036247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:41.036924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:41.041834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:41.042503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:41.470565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:41.496118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8399808-5820-4d33-83dc-7dfbc9083ff7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1275 microversion: 2.1 time: 0.490704 Apr 20 18:22:41.499172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 30/45] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:41 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1275 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:42.021334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:42.021929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:42.039532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:42.040038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:42.040899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:42.041946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:42.324009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:42.370669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eb28011e-248a-4e88-9188-b65c17462a97 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 4.215668 Apr 20 18:22:42.391375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 16/46] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:38 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 4236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:42.522267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:42.523067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:42.544249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:42.553213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:42.565405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:42.566076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:43.373984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:43.385049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1a31e49b-8e47-457a-bbb4-1da34386dc30 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1280 microversion: 2.1 time: 1.368232 Apr 20 18:22:43.395126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 31/47] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:42 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1280 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:43.407648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:43.408315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:43.421081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:43.423102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:43.425486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:43.426202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:44.142721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:44.167251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-41261f63-84bf-4875-bd1c-f19e0e39bf01 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.771353 Apr 20 18:22:44.167932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 32/48] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:43 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:44.830923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-b449690e-35a5-4355-aaf8-d0d04aed503a req-aa1d04ce-3ab4-401a-9fc0-fe6017a1353c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562396b5-ebca-460e-8500-5bc2457a73b8", "tag": "56ca2229-f046-42df-9a77-9642ea0c322e"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:44.833246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:22:44.833246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:22:44.864742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b449690e-35a5-4355-aaf8-d0d04aed503a req-aa1d04ce-3ab4-401a-9fc0-fe6017a1353c service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:44.865171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b449690e-35a5-4355-aaf8-d0d04aed503a req-aa1d04ce-3ab4-401a-9fc0-fe6017a1353c service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:44.916642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-b449690e-35a5-4355-aaf8-d0d04aed503a req-aa1d04ce-3ab4-401a-9fc0-fe6017a1353c service nova] Creating event network-changed:56ca2229-f046-42df-9a77-9642ea0c322e for instance 562396b5-ebca-460e-8500-5bc2457a73b8 on hv-cinder-78693 Apr 20 18:22:44.918724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b449690e-35a5-4355-aaf8-d0d04aed503a req-aa1d04ce-3ab4-401a-9fc0-fe6017a1353c service nova] Acquired lock "compute-rpcapi-router" {{(pid=100570) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 18:22:44.921505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:44.922905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:44.925212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:44.927908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:44.956018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.compute.rpcapi [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 18:22:44.957215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] Releasing lock "compute-rpcapi-router" {{(pid=100570) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 18:22:45.037285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-73edeba3-c62e-4bd7-b33d-6bf6904f6ce2 None None] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.855336 Apr 20 18:22:45.038107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 33/49] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:45.043911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:45.048301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:45.076270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:45.077872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:45.079211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:45.081273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:45.646241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:45.671243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c8495bd-6f27-42af-a50b-29de33978657 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 3.151874 Apr 20 18:22:45.673302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 17/50] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:42 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 3156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:22:45.697879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:45.699364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:45.726396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:45.729927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:45.731232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:45.737405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:46.411996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:46.431923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-70d45a3a-dffd-4d91-b05a-aed7b68675f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1280 microversion: 2.1 time: 1.392043 Apr 20 18:22:46.432528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 34/51] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:45 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1280 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:47.182017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2599b398-ce3b-430c-9934-5508b6949dbf tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Action: 'create', calling method: .version_select at 0x7f1a1c8d9d90>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-665682168", "metadata": {"Type": "work"}}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:47.188797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2599b398-ce3b-430c-9934-5508b6949dbf tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:47.190058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2599b398-ce3b-430c-9934-5508b6949dbf tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.741314 Apr 20 18:22:47.191049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 35/52] 10.222.0.22 () {60 vars in 1146 bytes} [Tue Apr 20 18:22:46 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 743 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:22:47.427247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f835d533-266e-4a3b-b2ad-591825328cdb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'create', calling method: .version_select at 0x7f1a1c8d9d08>, body: {"keypair": {"name": "tempest-keypair-1116938402"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:47.580326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-f835d533-266e-4a3b-b2ad-591825328cdb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:47.588394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:47.593099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-f835d533-266e-4a3b-b2ad-591825328cdb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for user 24529cdaf02244a78d926691d0342d01 and project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:47.601144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-46e2b8ed-acf5-4f91-a6d6-5d6bbe77ca6d tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 1.925820 Apr 20 18:22:47.602341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 18/53] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:45 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:47.615670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:47.636787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:47.665940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:47.671210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:47.672402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:47.674181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:48.136431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-f835d533-266e-4a3b-b2ad-591825328cdb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:48.141642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-f835d533-266e-4a3b-b2ad-591825328cdb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for user 24529cdaf02244a78d926691d0342d01 and project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:48.166133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f835d533-266e-4a3b-b2ad-591825328cdb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.973785 Apr 20 18:22:48.167140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 36/54] 10.222.0.22 () {62 vars in 1189 bytes} [Tue Apr 20 18:22:47 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 975 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:22:48.172511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6a6e1f78-4fc3-433c-85b0-bedabeda11bc tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Action: 'create', calling method: .version_select at 0x7f1a1c8d9510>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-687954139", "metadata": {"Type": "work"}}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:48.174288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6a6e1f78-4fc3-433c-85b0-bedabeda11bc tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:48.175645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6a6e1f78-4fc3-433c-85b0-bedabeda11bc tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007072 Apr 20 18:22:48.180946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 37/55] 10.222.0.22 () {60 vars in 1146 bytes} [Tue Apr 20 18:22:48 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:22:48.186503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:48.187351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:48.196811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:48.198065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:48.199149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:48.199827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:48.913785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:48.949016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9b8660f5-fdf8-4c29-91cb-8079382fc35a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.765911 Apr 20 18:22:48.949980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 38/56] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:48 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:48.961125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-80716ec7-2c83-45e9-a04c-2bc48fab8afe req-6a961857-877b-4633-b6cd-a4317e7c0c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f9d529-91fc-49e7-9140-ed7acdd0b2ed", "tag": "23191db0-aaaa-416e-8c4b-3abdefac96e7"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:48.967159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:22:48.967159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:22:48.988427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-80716ec7-2c83-45e9-a04c-2bc48fab8afe req-6a961857-877b-4633-b6cd-a4317e7c0c67 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:48.993625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-80716ec7-2c83-45e9-a04c-2bc48fab8afe req-6a961857-877b-4633-b6cd-a4317e7c0c67 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:49.045391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-80716ec7-2c83-45e9-a04c-2bc48fab8afe req-6a961857-877b-4633-b6cd-a4317e7c0c67 service nova] Creating event network-changed:23191db0-aaaa-416e-8c4b-3abdefac96e7 for instance d1f9d529-91fc-49e7-9140-ed7acdd0b2ed on hv-cinder-78693 Apr 20 18:22:49.065958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-80716ec7-2c83-45e9-a04c-2bc48fab8afe req-6a961857-877b-4633-b6cd-a4317e7c0c67 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106182 Apr 20 18:22:49.065958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 39/57] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:49.077164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8cea0c65-bdf2-4d2a-85d1-c47188c3f1a1 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Action: 'create', calling method: .version_select at 0x7f1a1c8d9400>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-722047866", "metadata": {"Type": "work"}}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:49.078687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8cea0c65-bdf2-4d2a-85d1-c47188c3f1a1 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:49.083501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8cea0c65-bdf2-4d2a-85d1-c47188c3f1a1 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019538 Apr 20 18:22:49.085337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 40/58] 10.222.0.22 () {60 vars in 1146 bytes} [Tue Apr 20 18:22:49 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:22:49.101321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:49.102142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:49.121518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:49.122053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:49.122961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:49.123464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:49.218481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:49.240889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b1f6d25b-02b3-469a-8479-7e9bd76f1280 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 1.637125 Apr 20 18:22:49.241542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 19/59] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:47 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:49.251613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d7da492-d4bd-4704-8558-479a172aa888 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Calling method '.version_select at 0x7f1a1c9400d0>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:49.424584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-0d7da492-d4bd-4704-8558-479a172aa888 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] HTTP exception thrown: Volume tempest-invalid-1071323781 could not be found. Apr 20 18:22:49.425249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d7da492-d4bd-4704-8558-479a172aa888 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Returning 404 to user: Volume tempest-invalid-1071323781 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:49.426150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d7da492-d4bd-4704-8558-479a172aa888 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1071323781" status: 404 len: 99 microversion: 2.1 time: 0.183612 Apr 20 18:22:49.427038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 20/60] 10.222.0.22 () {58 vars in 1208 bytes} [Tue Apr 20 18:22:49 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1071323781 => generated 99 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 18:22:49.436313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b7eed37b-1ac2-4538-8443-109d3794759d tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003818 Apr 20 18:22:49.437561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 21/61] 10.222.0.22 () {58 vars in 1130 bytes} [Tue Apr 20 18:22:49 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 18:22:49.446305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7178e211-6915-4398-b60b-87a16f151a55 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003675 Apr 20 18:22:49.447900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 22/62] 10.222.0.22 () {58 vars in 1127 bytes} [Tue Apr 20 18:22:49 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 20 18:22:49.456511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-70d58f3e-592e-4c45-97be-ebbdee49ce76 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Calling method '.version_select at 0x7f1a1c91e620>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:49.585417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-70d58f3e-592e-4c45-97be-ebbdee49ce76 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] HTTP exception thrown: Volume e98113f3-e124-42ac-8e9a-cec2276f20a9 could not be found. Apr 20 18:22:49.585417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-70d58f3e-592e-4c45-97be-ebbdee49ce76 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Returning 404 to user: Volume e98113f3-e124-42ac-8e9a-cec2276f20a9 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:49.585417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-70d58f3e-592e-4c45-97be-ebbdee49ce76 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "DELETE /compute/v2.1/os-volumes/e98113f3-e124-42ac-8e9a-cec2276f20a9" status: 404 len: 109 microversion: 2.1 time: 0.132870 Apr 20 18:22:49.593646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 23/63] 10.222.0.22 () {58 vars in 1238 bytes} [Tue Apr 20 18:22:49 2021] DELETE /compute/v2.1/os-volumes/e98113f3-e124-42ac-8e9a-cec2276f20a9 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:49.599790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e1cc050-3d8e-4cf2-9e20-852591f5f223 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Calling method '.version_select at 0x7f1a1c940048>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:49.805606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-7e1cc050-3d8e-4cf2-9e20-852591f5f223 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] HTTP exception thrown: Volume d05fa44d-aa7d-4c40-99f6-d3953eb87b11 could not be found. Apr 20 18:22:49.806564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e1cc050-3d8e-4cf2-9e20-852591f5f223 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] Returning 404 to user: Volume d05fa44d-aa7d-4c40-99f6-d3953eb87b11 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:22:49.808389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7e1cc050-3d8e-4cf2-9e20-852591f5f223 tempest-VolumesNegativeTest-313225992 tempest-VolumesNegativeTest-313225992-project] 10.222.0.22 "GET /compute/v2.1/os-volumes/d05fa44d-aa7d-4c40-99f6-d3953eb87b11" status: 404 len: 109 microversion: 2.1 time: 0.213531 Apr 20 18:22:49.809195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 24/64] 10.222.0.22 () {58 vars in 1235 bytes} [Tue Apr 20 18:22:49 2021] GET /compute/v2.1/os-volumes/d05fa44d-aa7d-4c40-99f6-d3953eb87b11 => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:22:49.885846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:49.899297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91de7528-798e-4b1a-bb77-b2b09458d7df tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.812551 Apr 20 18:22:49.904197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 41/65] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:49 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:49.968532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:49.969340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:50.000203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:50.011301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:50.014581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:50.016552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:50.259040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:50.259963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:50.283792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:50.284384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:50.300310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:50.303205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:50.911124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:50.929124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b1b59e54-d2f7-45c8-8d30-c3d6aaf20a3e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.965975 Apr 20 18:22:50.929866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 25/66] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:49 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:50.952061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:50.953039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:50.974741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:50.975768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:50.976840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:50.977524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:51.944025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:51.955892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cce90dd5-b936-451f-9f41-9748b3c0d375 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 1.012157 Apr 20 18:22:51.958108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 26/67] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:50 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:52.034062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:52.048265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-73e22e7a-bca3-405e-92b2-fc8d2170b5f5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 1.793283 Apr 20 18:22:52.051924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 42/68] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:50 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:52.069586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:52.070536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:52.098762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:52.104563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:52.105617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:52.106124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:52.450172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d9ad490c-5be3-4af6-badb-1f8c0ed8c8a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: .version_select at 0x7f1a1d1e0f28>, body: {"keypair": {"name": "tempest-keypair-2071073607"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:52.552181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d9ad490c-5be3-4af6-badb-1f8c0ed8c8a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:52.562889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d9ad490c-5be3-4af6-badb-1f8c0ed8c8a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for user 822060e8b68d4cbc97a4331cd4383a88 and project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:53.019343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d9ad490c-5be3-4af6-badb-1f8c0ed8c8a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:53.024239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d9ad490c-5be3-4af6-badb-1f8c0ed8c8a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for user 822060e8b68d4cbc97a4331cd4383a88 and project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:53.046711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d9ad490c-5be3-4af6-badb-1f8c0ed8c8a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.087147 Apr 20 18:22:53.048076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 27/69] 10.222.0.22 () {60 vars in 1148 bytes} [Tue Apr 20 18:22:51 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:53.058943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:53.059780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:53.086492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:53.091698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:53.092609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:53.093107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:53.783537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:53.799146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-857faaec-bff7-40ac-b3cd-882b85c8fdbe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 1.733976 Apr 20 18:22:53.799783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 43/70] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:52 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:53.813055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:53.813729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:53.832154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:53.832657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:53.833518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:53.834013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:54.217608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:54.232228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8cb4a397-328c-4e6f-87c2-43a76b7f6adc tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 1.182812 Apr 20 18:22:54.233789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 28/71] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:53 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:54.817426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:54.818720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:54.837704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:54.838421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:54.839876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:54.840855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:55.766985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:55.781859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-027541ae-7f82-4950-bd03-e166b5a2ebe6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 1.980905 Apr 20 18:22:55.796111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 44/72] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:53 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:56.055059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-58ee7b2a-c1de-49fd-82e4-7dc410537bdb req-b62a6048-d9e2-4fde-a3ec-9820af51ccdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888724ad-feda-4539-a72f-4c20f18b223d", "tag": "f4183893-034f-4afd-ada7-b34dd9be918e"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:56.058057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:22:56.058057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:22:56.074850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-58ee7b2a-c1de-49fd-82e4-7dc410537bdb req-b62a6048-d9e2-4fde-a3ec-9820af51ccdb service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:56.076858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-58ee7b2a-c1de-49fd-82e4-7dc410537bdb req-b62a6048-d9e2-4fde-a3ec-9820af51ccdb service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:56.118530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-58ee7b2a-c1de-49fd-82e4-7dc410537bdb req-b62a6048-d9e2-4fde-a3ec-9820af51ccdb service nova] Creating event network-changed:f4183893-034f-4afd-ada7-b34dd9be918e for instance 888724ad-feda-4539-a72f-4c20f18b223d on hv-cinder-78693 Apr 20 18:22:56.125254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-58ee7b2a-c1de-49fd-82e4-7dc410537bdb req-b62a6048-d9e2-4fde-a3ec-9820af51ccdb service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327594 Apr 20 18:22:56.128282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 45/73] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:22:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:56.134431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:56.136436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:56.145239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:56.146084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:56.147358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:56.147490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:56.148181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:56.164446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-02c5f28e-eb15-4661-9662-3f9034e20a90 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 1.351305 Apr 20 18:22:56.177216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 29/74] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:54 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:22:56.189672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1342514232", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a442676-e97d-483e-b6c5-5a6a805f152b"}], "security_groups": [{"name": "tempest-securitygroup--1410502523"}], "key_name": "tempest-keypair-1116938402", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:56.487976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:56.502245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-69758c50-392d-40bb-97bc-b0399666b28b tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.372411 Apr 20 18:22:56.511655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 46/75] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:56 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:56.519034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] validate_networks() for [('0a442676-e97d-483e-b6c5-5a6a805f152b', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:22:56.809260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:56.812021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:56.831637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:56.832623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:56.834045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:56.835136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.302302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:57.316783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-de287a42-edd9-456f-924d-5b833e2f7827 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.508035 Apr 20 18:22:57.316783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 47/76] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:56 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:22:57.320116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:57.320787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:57.332789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:57.333531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.334726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:57.335418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.477734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:22:57.478849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:22:57.479362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:22:57.479827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Image pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:22:57.480290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:22:57.495003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:57.495167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.496295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:57.496796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.518530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for project ef76467afabe40069eec102250c40fc0. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:22:57.523243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for user 24529cdaf02244a78d926691d0342d01 and project ef76467afabe40069eec102250c40fc0. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:22:57.535973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Going to run 1 instances... {{(pid=100569) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:22:57.539025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100569) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:22:57.593010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dc1b6b14-0a70-4a83-bc33-f3f9c272357e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.420922 Apr 20 18:22:57.594077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 30/77] 10.222.0.22 () {62 vars in 1178 bytes} [Tue Apr 20 18:22:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 18:22:57.599647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:57.600525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:57.610848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:57.611670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.612751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:57.613388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:57.887323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:57.893829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:57.900762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4cdee34d-8b69-4043-a5ac-4048afd9d147 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.304264 Apr 20 18:22:57.900876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 31/78] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:57 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:57.905922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-06ad07bf-441b-402f-8b42-e4ea61d7c90f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:57.906623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-06ad07bf-441b-402f-8b42-e4ea61d7c90f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:57.915420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-296d9cb3-f3ad-4547-a259-1c400691098c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.601037 Apr 20 18:22:57.916098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 48/79] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:57 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:57.994353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06ad07bf-441b-402f-8b42-e4ea61d7c90f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:58.004115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06ad07bf-441b-402f-8b42-e4ea61d7c90f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:58.006100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06ad07bf-441b-402f-8b42-e4ea61d7c90f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:58.007514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-06ad07bf-441b-402f-8b42-e4ea61d7c90f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1282 microversion: 2.20 time: 0.105656 Apr 20 18:22:58.010513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 32/80] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:22:57 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:22:58.187811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-009505c4-4536-4931-8a32-4d1d704d4e85 req-d9c1787c-a338-4c07-a26b-103e0c248c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2", "tag": "d239680d-38c9-4ba3-bd52-11d907a6c4ab"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:58.189689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:22:58.189689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:22:58.198945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-009505c4-4536-4931-8a32-4d1d704d4e85 req-d9c1787c-a338-4c07-a26b-103e0c248c0a service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:58.199439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-009505c4-4536-4931-8a32-4d1d704d4e85 req-d9c1787c-a338-4c07-a26b-103e0c248c0a service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:58.217071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-009505c4-4536-4931-8a32-4d1d704d4e85 req-d9c1787c-a338-4c07-a26b-103e0c248c0a service nova] Creating event network-changed:d239680d-38c9-4ba3-bd52-11d907a6c4ab for instance 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 on hv-cinder-78693 Apr 20 18:22:58.222526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-009505c4-4536-4931-8a32-4d1d704d4e85 req-d9c1787c-a338-4c07-a26b-103e0c248c0a service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038611 Apr 20 18:22:58.223666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 49/81] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:22:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:58.334680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:58.335544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:58.346106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:58.347073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:58.349668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:58.350867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:58.646726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1309408257", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ca6af4a-0ad6-45b9-a16f-a46c80d90308"}], "security_groups": [{"name": "tempest-securitygroup--392133946"}], "key_name": "tempest-keypair-2071073607", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:22:58.729471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:58.747496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6b390f5a-8148-4ea5-9e22-5e88cc42d7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.420225 Apr 20 18:22:58.748126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 33/82] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:58 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:58.919735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:58.920730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:58.935751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:58.936248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:58.937069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:58.937552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:59.296941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] validate_networks() for [('4ca6af4a-0ad6-45b9-a16f-a46c80d90308', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:22:59.401144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:59.413037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-39acabe9-0bf5-4121-9c70-c91917804cf9 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.499016 Apr 20 18:22:59.413988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 34/83] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:58 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:22:59.419022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:59.419776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:59.428593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:59.429430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:59.430726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:59.430889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:59.790789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:22:59.810313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ef5188db-0b23-488b-930d-04598561e9ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.395205 Apr 20 18:22:59.812433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 35/84] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:22:59 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:22:59.825893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:59.826601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:22:59.844785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:59.845288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:59.846135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:59.846646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:59.996778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:23:00.000144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:23:00.000783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:23:00.001331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:23:00.002009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:23:00.012077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.012696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.013756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.014334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.033876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:23:00.049022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for user 822060e8b68d4cbc97a4331cd4383a88 and project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:23:00.063314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:23:00.066951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:23:00.068076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:00.080221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:00.082341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:00.083682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a52e18dd-3a72-4cbc-b1cc-663c32a05a8a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1278 microversion: 2.20 time: 0.268761 Apr 20 18:23:00.084955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 36/85] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:22:59 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:00.089878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:00.090539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:00.099682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.100274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.101328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.102014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.123124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-57c7a766-e1d4-4987-bb9d-1a225a55a913 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.481606 Apr 20 18:23:00.123803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 50/86] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:22:58 2021] POST /compute/v2.1/servers => generated 401 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:23:00.134953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bfe2f054-bf27-4fa9-87dd-e4ba6a94a05d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:00.135954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bfe2f054-bf27-4fa9-87dd-e4ba6a94a05d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:00.247206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bfe2f054-bf27-4fa9-87dd-e4ba6a94a05d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:00.269392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bfe2f054-bf27-4fa9-87dd-e4ba6a94a05d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1238 microversion: 2.1 time: 0.138768 Apr 20 18:23:00.275601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 51/87] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:00 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:00.362308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:00.374449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d1447dc4-da8d-40c5-9bf5-b683a781ccae tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.288816 Apr 20 18:23:00.375115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 37/88] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:00 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:00.432660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:00.433679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:00.442151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.442962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.446649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.446649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.669384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:00.678255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-21ccad46-1262-436a-97e1-b73bed7c3d38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.251318 Apr 20 18:23:00.678911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 52/89] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:00 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:00.829424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:00.830299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:00.838798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.839422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:00.840250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:00.843592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.107288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:01.108661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:01.118915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.119434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.120290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.120781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.251950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.258965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.262243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6cd1560b-45b7-4f6c-bf7c-12d6c9f734f4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.436792 Apr 20 18:23:01.262917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 38/90] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:00 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:01.269105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.270815 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.271969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-70cece67-cf39-4017-a32d-6caa446177bd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1278 microversion: 2.20 time: 0.171859 Apr 20 18:23:01.272575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 53/91] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:01 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:01.292855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:01.293521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:01.301347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.301854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.302754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.303246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.392507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:01.393145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:01.401362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.401874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.402733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.403235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.445084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.457172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8c247ada-5511-425a-bfb9-47dcd0c3b648 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1242 microversion: 2.1 time: 0.168244 Apr 20 18:23:01.458167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 39/92] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:01 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:01.695602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:01.696281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:01.704570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.705519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.706588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:01.707249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:01.762727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.772444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-01fe1357-f6a3-45b4-931b-7d5bdc58e7a8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.383974 Apr 20 18:23:01.774525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 54/93] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:01 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:01.928426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:01.937747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-aa34f579-c3b9-4a98-88af-456f1510e22e tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.246507 Apr 20 18:23:01.938345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 40/94] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:01 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:02.280754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:02.281397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:02.291864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:02.292498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:02.293359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.293876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.294768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.295484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.300246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.300954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.301975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.302734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.460125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:02.471263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:02.473048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:02.474435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c60b38ed-0fe7-47fc-b1ad-d9ee39cd23e9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1334 microversion: 2.20 time: 0.187174 Apr 20 18:23:02.485781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 41/95] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:02 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:02.485781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:02.485781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:02.492382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.493425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.494955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.495871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.620738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:02.623849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:02.629763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ffaadac-124e-45c9-8744-bfb12ad0d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1234 microversion: 2.1 time: 0.153581 Apr 20 18:23:02.634790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 42/96] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:02 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1234 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:02.637303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5781cd5e-906f-469b-b4b1-29f210892cee tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.360501 Apr 20 18:23:02.637895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 55/97] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:02 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:02.791361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:02.792034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:02.803271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.803923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.804783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.805280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.955273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:02.956055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:02.964679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.965211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:02.966150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:02.966752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.031835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.041575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-90f6013d-1da6-4c80-bef0-dc95f8febccf tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.253520 Apr 20 18:23:03.042311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 43/98] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:02 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:03.181200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.191150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-090c881f-ead8-494b-8d3b-05cdd4e7fd7f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.239805 Apr 20 18:23:03.191820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 56/99] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:02 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:03.494167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:03.494863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:03.502743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:03.503246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.504073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:03.504564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.637233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.647164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.649584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:03.649695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.649778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:03.650408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fb19f77e-208e-4d3c-9d6b-8cac54aaf6af tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1334 microversion: 2.20 time: 0.160840 Apr 20 18:23:03.651181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 44/100] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:03 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:03.655642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:03.656303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:03.666582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:03.667159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:03.667336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.667670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.668397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:03.668471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:03.668902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.669001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:03.809433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.818535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fc6edb27-25ab-4e9c-ab22-53b8c49cdb4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1234 microversion: 2.1 time: 0.174210 Apr 20 18:23:03.819447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 57/101] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:03 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1234 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:03.889505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:03.898313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-762bf9eb-f6bb-4a24-ac50-d295132734bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.246243 Apr 20 18:23:03.898974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 45/102] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:03 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:04.059898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:04.060608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:04.068994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.069498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.070330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.070895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.213926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:04.214627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:04.222611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.223119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.224153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.224434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.320859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:04.332151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-95180cc6-529f-4c93-9cd8-529732121ef0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.276019 Apr 20 18:23:04.332887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 58/103] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:04 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:04.454816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:04.463861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5a230cf4-808f-4e38-8df1-cb32daa731a1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.254514 Apr 20 18:23:04.464466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 46/104] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:04 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:04.670179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:04.670878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:04.678718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.679226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.680068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.680568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.811041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:04.827864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:04.829446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:04.830650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d5a7b000-d60c-4f57-a2c5-42a021a28582 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1334 microversion: 2.20 time: 0.165430 Apr 20 18:23:04.831635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 59/105] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:04 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1334 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:04.836657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:04.837349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:04.845084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.845581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.846400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.846910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.917395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:04.918151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:04.926051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.926816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.927711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:04.928415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:04.972082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:04.981690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-09e04a39-717f-45c0-b6bb-5eec0dac7b09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1234 microversion: 2.1 time: 0.149104 Apr 20 18:23:04.982551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 47/106] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:04 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1234 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:05.227763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:05.238851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-74c54bf2-837b-4fc3-8e9f-7f4fb0e4dfac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.326008 Apr 20 18:23:05.239598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 60/107] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:04 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:05.350835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:05.351789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:05.362898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.363786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.364913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.365585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.481631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:05.482301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:05.506649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.507166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.511907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.512559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.804020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:05.813860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-06638804-6642-4ae0-b464-49a843f66645 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.467686 Apr 20 18:23:05.823831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 48/108] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:05 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:05.849496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:05.860698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-06034093-c7f3-45a9-96b2-904f96a3bfe8 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.383079 Apr 20 18:23:05.861517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 61/109] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:05 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:05.867165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:05.868032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:05.876006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.876574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.877358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.877945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.909013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-ea0147ab-a13c-4692-8904-a7e6d09ed7f3 req-300c751e-444d-4760-9599-f006f3a822e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562396b5-ebca-460e-8500-5bc2457a73b8", "name": "network-vif-plugged", "status": "completed", "tag": "56ca2229-f046-42df-9a77-9642ea0c322e"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:05.912537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:05.912537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:05.922677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ea0147ab-a13c-4692-8904-a7e6d09ed7f3 req-300c751e-444d-4760-9599-f006f3a822e6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.923275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ea0147ab-a13c-4692-8904-a7e6d09ed7f3 req-300c751e-444d-4760-9599-f006f3a822e6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.943818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-ea0147ab-a13c-4692-8904-a7e6d09ed7f3 req-300c751e-444d-4760-9599-f006f3a822e6 service nova] Creating event network-vif-plugged:56ca2229-f046-42df-9a77-9642ea0c322e for instance 562396b5-ebca-460e-8500-5bc2457a73b8 on hv-cinder-78693 Apr 20 18:23:05.944525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ea0147ab-a13c-4692-8904-a7e6d09ed7f3 req-300c751e-444d-4760-9599-f006f3a822e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=100569) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 18:23:05.945745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.946435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.947362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:05.948291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:05.958082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.compute.rpcapi [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 18:23:05.959104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] Releasing lock "compute-rpcapi-router" {{(pid=100569) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 18:23:05.987930 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-13f6df9c-c52e-407c-8e9d-f54fe004dc17 None None] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147318 Apr 20 18:23:05.988572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 49/110] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:05.999618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:06.000374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:06.006574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:06.008696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.009273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.010112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.010635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.016518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:06.018372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:06.019568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6606816b-b800-4f1e-91f7-c6eb8c2e3b9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1352 microversion: 2.20 time: 0.156712 Apr 20 18:23:06.020832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 62/111] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:05 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:06.138067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:06.146993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-580fdd98-111f-4132-9221-9b0d752fe05e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1290 microversion: 2.1 time: 0.151789 Apr 20 18:23:06.147720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 50/112] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:05 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1290 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:06.256493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:06.257357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:06.265740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.266366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.267279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.267773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.498799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:06.508183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cb64c4e5-2dc2-4043-85b5-60c5be16bb70 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.255717 Apr 20 18:23:06.509967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 63/113] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:06 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:06.831823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:06.832485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:06.840387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.840885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.841705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.842190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.878808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:06.879474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:06.887369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.887873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:06.888705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:06.889197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.056928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.065970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-63d000fb-b8ff-4ea3-b014-1a01f5fb90a9 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.238214 Apr 20 18:23:07.066632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 51/114] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:06 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:07.071664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:07.072327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:07.080142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:07.080625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.081465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:07.081959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.104532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.113409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-35468c6e-85ba-41de-bb2a-2f77e55e14d1 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.238660 Apr 20 18:23:07.114024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 64/115] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:06 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:07.165194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:07.166414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:07.174960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:07.175460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.176295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:07.176782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.205129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.215538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.217423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.218444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6df2929e-30be-445e-841c-50f1c01e35e5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1352 microversion: 2.20 time: 0.150491 Apr 20 18:23:07.218993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 52/116] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:07 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:07.300483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.309162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ca92bac1-425e-426f-83df-65ce205ce1ed tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1290 microversion: 2.1 time: 0.147989 Apr 20 18:23:07.309775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 65/117] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:07 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:07.527827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:07.528486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:07.536507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:07.537004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.537827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:07.538314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:07.754684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:07.764231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ba9f2af8-5ab5-4eac-93c0-d60932b84346 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.240940 Apr 20 18:23:07.765003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 53/118] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:07 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:08.083840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:08.084507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:08.092567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.093075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.093909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.094404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.131683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:08.132350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:08.140751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.141253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.142083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.142617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.311886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:08.320735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-77ec68eb-3db8-449a-ad0e-908e8f12f0cd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.240890 Apr 20 18:23:08.321336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 66/119] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:08 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:08.327040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:08.327689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:08.335159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.335603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.336421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.336904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.357090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:08.367486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0801b9a8-b66a-4837-afe9-17d141ef9b38 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.239824 Apr 20 18:23:08.368116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 54/120] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:08 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:08.377954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:08.377954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:08.390010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.391234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.392238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.393256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.633516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:08.644938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c1454d97-3ce2-4e92-81a0-480f51919e80 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1290 microversion: 2.1 time: 0.275701 Apr 20 18:23:08.650603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 55/121] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:08 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1290 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:08.672480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:08.700766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:08.704887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:08.706623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3775f3d7-c366-4972-950a-9ba3bbfa260e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1352 microversion: 2.20 time: 0.383185 Apr 20 18:23:08.707439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 67/122] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:08 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1352 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:08.783071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:08.783847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:08.793643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.794314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:08.795274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:08.795990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.338897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:09.339577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:09.357264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.357779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.358666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.359168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.483749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:09.497685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f3d3ab30-68a3-4dd0-9fca-4a11400e1e63 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.719899 Apr 20 18:23:09.509037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 56/123] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:08 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:09.516261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:09.517754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:09.529074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.529952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.531720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.532415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.863286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:09.873407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ffe414fb-1c05-42a7-a13a-3b5cc023c212 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.362837 Apr 20 18:23:09.874214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 57/124] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:09 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:09.889871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:09.890793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:09.899120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.899689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.900539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.901022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.907266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:09.917655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-66fedaae-da44-4269-b1dc-cbd04847e675 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.582751 Apr 20 18:23:09.918907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 68/125] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:09 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:09.926225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:09.927524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:09.935960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.936475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:09.937569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:09.938180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:10.065704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:10.077058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5d313284-60db-41fd-88cf-2c345392c385 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1296 microversion: 2.1 time: 0.192344 Apr 20 18:23:10.077944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 58/126] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:09 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1296 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:10.225565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:10.242189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:10.244746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:10.246216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-927a745f-4450-41f4-ae8a-8531306500de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1340 microversion: 2.20 time: 0.326444 Apr 20 18:23:10.247524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 69/127] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:09 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1340 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:10.515980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:10.517083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:10.526131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:10.526732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:10.527651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:10.528356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:10.773083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:10.783238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6e2109c3-1a00-4a46-a32c-1bc6b6f1b7e1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.271276 Apr 20 18:23:10.784601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 59/128] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:10 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:10.891388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:10.892187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:10.900890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:10.901400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:10.902233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:10.902744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:10.936031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:10.936697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:10.944564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:10.945071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:10.945914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:10.946404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:11.199586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:11.208840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9d1e357c-c698-45a5-9dd9-4b5702aec4de tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.277531 Apr 20 18:23:11.209575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 60/129] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:10 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:11.230669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:11.231692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:11.240498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:11.241010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:11.241872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:11.242566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:11.268357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:11.278860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7ba8e484-8795-4b7f-814c-3e92de9a7667 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.391495 Apr 20 18:23:11.279762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 70/130] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:10 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:11.285037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:11.286300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:11.295987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:11.296707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:11.297758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:11.298442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:11.518029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:11.529090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f64fdba6-035f-4ed0-800d-313a9ea891b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.307958 Apr 20 18:23:11.529732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 61/131] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:11 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:11.568083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:11.578963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:11.580654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:11.581862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d51b23d5-2b06-4878-a780-80f2dd6b275f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.300777 Apr 20 18:23:11.582741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 71/132] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:11 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:11.805205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:11.806516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:11.814494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:11.815033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:11.815912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:11.816360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.023185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.032272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-87f866ad-10eb-47ce-9e2b-993a7ff5339d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.231326 Apr 20 18:23:12.032892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 62/133] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:11 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:12.227330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:12.228016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:12.235768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.236261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.237078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.237565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.296785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:12.297552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:12.305365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.305880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.306759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.307251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.457489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.466912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d12c1be6-21f8-47d3-ac7d-e6faac3ce5f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.243523 Apr 20 18:23:12.467538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 72/134] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:12 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:12.526087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.534907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-daab8fba-ee9c-48e1-9671-d66b1c8d1460 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.242134 Apr 20 18:23:12.535790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 63/135] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:12 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:12.547510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:12.548171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:12.556448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.556946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.557770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.558255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.602273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:12.602982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:12.610857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.611370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.612204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:12.612699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:12.791893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.801074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ac6e5fef-5246-4198-9236-24246cd45410 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.257541 Apr 20 18:23:12.801871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 73/136] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:12 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:12.829834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.839276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.840941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:12.842090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8da10d3c-df84-492e-8022-89b3fa970c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.244292 Apr 20 18:23:12.842776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 64/137] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:12 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:13.050882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:13.051518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:13.060020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.060559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.061386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.061864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.269954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:13.279154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-60254255-8fa2-4556-b4fb-72d89c32d4df tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.232377 Apr 20 18:23:13.279765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 74/138] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:13 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:13.484872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:13.485545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:13.493678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.494519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.495040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.495534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.554405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:13.555668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:13.563828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.564551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.565973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.566651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.804892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:13.815295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b89b4276-98b9-4e26-9ff6-7d1e580c5264 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.334409 Apr 20 18:23:13.815936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 65/139] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:13 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:13.825643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:13.825643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:13.831507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.832024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:13.833049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:13.834066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.108058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:14.118354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c5488198-5e41-4304-9b7e-bc2e8af49c22 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.300432 Apr 20 18:23:14.119098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 66/140] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:13 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:14.125139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:14.125814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:14.134246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.134932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.135786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.136342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.368672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:14.389028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a46d7422-841f-4494-a0b0-06f2cf47c7fe tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1315 microversion: 2.1 time: 0.839443 Apr 20 18:23:14.406535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 75/141] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:13 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:14.412614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-1d07bff9-77fe-4fb4-b868-9c918334fcbb req-3bf8df59-5c7f-4c5f-96b6-182e65f243d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888724ad-feda-4539-a72f-4c20f18b223d", "name": "network-vif-plugged", "status": "completed", "tag": "f4183893-034f-4afd-ada7-b34dd9be918e"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:14.415292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:14.415292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:14.427074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1d07bff9-77fe-4fb4-b868-9c918334fcbb req-3bf8df59-5c7f-4c5f-96b6-182e65f243d8 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.427797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1d07bff9-77fe-4fb4-b868-9c918334fcbb req-3bf8df59-5c7f-4c5f-96b6-182e65f243d8 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.449252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-1d07bff9-77fe-4fb4-b868-9c918334fcbb req-3bf8df59-5c7f-4c5f-96b6-182e65f243d8 service nova] Creating event network-vif-plugged:f4183893-034f-4afd-ada7-b34dd9be918e for instance 888724ad-feda-4539-a72f-4c20f18b223d on hv-cinder-78693 Apr 20 18:23:14.455901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-1d07bff9-77fe-4fb4-b868-9c918334fcbb req-3bf8df59-5c7f-4c5f-96b6-182e65f243d8 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047699 Apr 20 18:23:14.457690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 76/142] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:14.462692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:14.465502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:14.480326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:14.480962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:14.487173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:14.488485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bb050647-15b9-45c8-a4f7-e6fc53064e5a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.368300 Apr 20 18:23:14.489301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 67/143] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:14 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:14.499663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.500515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.503969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.504875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.833357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:14.834090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:14.847697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.847697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:14.848440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:14.848935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.177577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.220327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-725bc7ae-3e11-42d6-aecf-071d93be04fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.390875 Apr 20 18:23:15.221442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 68/144] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:14 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:15.226805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:15.227475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:15.236005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.236528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.237401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.237923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.377946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.388004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a9039101-9c65-452d-b6b5-c09685e00b02 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.928681 Apr 20 18:23:15.392858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 77/145] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:14 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:15.414247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:15.414953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:15.429603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.430612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.432317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.433072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.514515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.524084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dd3b180e-2dc6-4b5d-8fff-44e5375e1ab9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.301435 Apr 20 18:23:15.526503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 69/146] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:15 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:15.530720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:15.531442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:15.539800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.540929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.541844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.542364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.766806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.777620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.779581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.780839 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-87b10e5f-0254-4509-b779-65f6c8c9ae8c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.254567 Apr 20 18:23:15.781510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 70/147] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:15 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:15.917713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-c917f062-fdd5-4b3d-b695-29065bce8d66 req-9c5b0553-8d4f-43a6-895f-6688e8635808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291eea25-3def-4661-bf74-4a540fedde0a", "tag": "0687950b-e993-4a24-910e-500f131bfe37"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:15.920762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:15.920762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:15.940941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:15.941530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c917f062-fdd5-4b3d-b695-29065bce8d66 req-9c5b0553-8d4f-43a6-895f-6688e8635808 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:15.943818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c917f062-fdd5-4b3d-b695-29065bce8d66 req-9c5b0553-8d4f-43a6-895f-6688e8635808 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:15.950355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-85931958-d9c5-4b37-b274-c1a4b3de1652 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1502 microversion: 2.1 time: 0.540754 Apr 20 18:23:15.951096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 78/148] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:15 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1502 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:16.000573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-c917f062-fdd5-4b3d-b695-29065bce8d66 req-9c5b0553-8d4f-43a6-895f-6688e8635808 service nova] Creating event network-changed:0687950b-e993-4a24-910e-500f131bfe37 for instance 291eea25-3def-4661-bf74-4a540fedde0a on hv-cinder-78693 Apr 20 18:23:16.015661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-c917f062-fdd5-4b3d-b695-29065bce8d66 req-9c5b0553-8d4f-43a6-895f-6688e8635808 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100641 Apr 20 18:23:16.016358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 71/149] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:16.238795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:16.239474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:16.254897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.259109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:16.260648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.265227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:16.410777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:16.411946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:16.429509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.430122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:16.431298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.437649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:16.758264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:16.771132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a01e8f7f-1c39-4d07-a6df-2776108813c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.364961 Apr 20 18:23:16.775016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 72/150] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:16 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:16.791006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-693975c8-4dc9-4e7f-9268-df92f45d9514 req-73a0dcc4-55a9-4e66-9567-133a6886e393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f9d529-91fc-49e7-9140-ed7acdd0b2ed", "name": "network-vif-plugged", "status": "completed", "tag": "23191db0-aaaa-416e-8c4b-3abdefac96e7"}, {"server_uuid": "6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2", "name": "network-vif-plugged", "status": "completed", "tag": "d239680d-38c9-4ba3-bd52-11d907a6c4ab"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:16.795564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:16.795564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:16.822179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-693975c8-4dc9-4e7f-9268-df92f45d9514 req-73a0dcc4-55a9-4e66-9567-133a6886e393 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.822809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-693975c8-4dc9-4e7f-9268-df92f45d9514 req-73a0dcc4-55a9-4e66-9567-133a6886e393 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:16.859671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-693975c8-4dc9-4e7f-9268-df92f45d9514 req-73a0dcc4-55a9-4e66-9567-133a6886e393 service nova] Creating event network-vif-plugged:23191db0-aaaa-416e-8c4b-3abdefac96e7 for instance d1f9d529-91fc-49e7-9140-ed7acdd0b2ed on hv-cinder-78693 Apr 20 18:23:16.870584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-693975c8-4dc9-4e7f-9268-df92f45d9514 req-73a0dcc4-55a9-4e66-9567-133a6886e393 service nova] Creating event network-vif-plugged:d239680d-38c9-4ba3-bd52-11d907a6c4ab for instance 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 on hv-cinder-78693 Apr 20 18:23:16.893765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-693975c8-4dc9-4e7f-9268-df92f45d9514 req-73a0dcc4-55a9-4e66-9567-133a6886e393 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.111913 Apr 20 18:23:16.894985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 73/151] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:16 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:16.919235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:16.919235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:16.949945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.950849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:16.956522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:16.957328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:17.184186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:17.194733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8f749fa7-7e43-427d-9566-303a9329cf35 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.959764 Apr 20 18:23:17.195829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 79/152] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:16 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:17.202030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:17.203087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:17.212051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:17.212803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:17.213848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:17.214563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:17.379718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:17.389864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dfdf0a7e-70ec-4379-aadb-ca185dd9ba8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.493028 Apr 20 18:23:17.390513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 74/153] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:16 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:17.792011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:17.792900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:17.800880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:17.801470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:17.802405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:17.803129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:17.934940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:17.945644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:17.947708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:17.949093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-87eef774-9d68-40d3-8b64-2eab2250ef49 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.751425 Apr 20 18:23:17.949825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 80/154] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:17 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:18.016652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:18.026041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-afc9e4f0-4b21-411e-b67a-ae87b3dae4ce tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.238767 Apr 20 18:23:18.026677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 75/155] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:17 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:18.041835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92f92f7d-14b6-4901-960b-5c06580b6512"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:18.043626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:18.051863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.052394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.053358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.053861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.063045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-9f29d09e-07cf-40e1-a509-b9c459b52dd5 req-cdb644ed-917c-4738-a25e-5b549a4cfadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:18.064746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:18.064746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:18.074288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9f29d09e-07cf-40e1-a509-b9c459b52dd5 req-cdb644ed-917c-4738-a25e-5b549a4cfadd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.074821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9f29d09e-07cf-40e1-a509-b9c459b52dd5 req-cdb644ed-917c-4738-a25e-5b549a4cfadd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.096892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-9f29d09e-07cf-40e1-a509-b9c459b52dd5 req-cdb644ed-917c-4738-a25e-5b549a4cfadd service nova] Creating event network-changed:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:23:18.102301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-9f29d09e-07cf-40e1-a509-b9c459b52dd5 req-cdb644ed-917c-4738-a25e-5b549a4cfadd service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043051 Apr 20 18:23:18.103219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 76/156] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:18.215746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:18.217056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:18.225702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.226212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.227076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.227614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.444195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:18.453197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b638d3e7-c2b8-4801-862e-1b04b556a914 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.242750 Apr 20 18:23:18.453816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 77/157] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:18 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:18.458517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:18.459190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:18.467282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.467794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.468628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.469127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.693348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:18.702189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8dd5bead-f753-42d2-89c8-3b9cc878ed4c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.247360 Apr 20 18:23:18.702829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 78/158] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:18 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:18.968932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:18.969585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:18.977320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.977813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:18.978659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:18.979148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.190935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:19.200688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:19.202340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:19.203533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-78bd69f2-aecb-4565-b9aa-6f11d50b9f0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.238669 Apr 20 18:23:19.204138 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 79/159] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:18 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:23:19.208640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:19.209286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:19.217110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:19.217606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.218422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:19.218928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.427189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:19.436445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-79e3bd53-0fb8-42e9-8d4d-fa111c7a9b84 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.231302 Apr 20 18:23:19.437062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 80/160] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:19 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:19.470517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:19.471166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:19.478598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:19.479099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.479970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:19.480452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.692972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:19.701912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-15bffbac-59e5-49bf-ba1b-485865cf2e83 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.235088 Apr 20 18:23:19.702555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 81/161] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:19 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:19.720159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:19.721171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:19.729685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:19.730181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.731056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:19.731539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:19.945332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:19.954196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a4a92c03-1a58-4131-b527-2065e33bd0b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.237830 Apr 20 18:23:19.954841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 82/162] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:19 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:20.223080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:20.223735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:20.232132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.232638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.233462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.233951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.443143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:20.453122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:20.454820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:20.455974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5c1f84bb-ee91-4b4a-a526-c2c5c73224b8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.236817 Apr 20 18:23:20.456581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 83/163] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:20 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:23:20.461120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:20.462362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:20.469730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.470230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.471119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.471605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.681429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:20.690251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d4ddcf87-32b0-4637-b118-1fe086e83fa0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.232666 Apr 20 18:23:20.690888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 84/164] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:20 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:20.719589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:20.720293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:20.729949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.730320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.731181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.731667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.950303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:20.959565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3c52154d-b1c3-4120-831d-5c5cb43f86af tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.243866 Apr 20 18:23:20.960188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 85/165] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:20 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:20.971508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:20.972646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:20.981092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.981594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:20.982491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:20.982985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:21.196012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:21.205404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-28661b52-c02d-4ef0-9b7c-0076915a0d49 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.237740 Apr 20 18:23:21.206027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 86/166] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:20 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:21.476185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:21.476848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:21.485522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:21.486032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:21.486924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:21.487410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:21.513597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b520e697-b98c-4619-8bf7-fb4610b43973 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "POST /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.476286 Apr 20 18:23:21.514424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 81/167] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:23:18 2021] POST /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8/os-volume_attachments => generated 194 bytes in 3478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:21.708713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:21.710227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:21.711604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:21.719279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:21.719858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:21.720674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:21.721176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:21.723136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:21.726258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:21.727550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9cc91cc9-e3aa-43f3-b32a-cbfe675f0194 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.255391 Apr 20 18:23:21.728964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 87/168] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:21 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:23:21.981182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:21.982239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:21.990823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:21.991442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:21.992397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:21.993560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:22.235159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:22.244806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-841a9b8b-7229-431a-842b-8c57f695730b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.268471 Apr 20 18:23:22.254919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 88/169] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:21 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:22.254919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:22.254919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:22.259343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:22.259971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:22.260809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:22.261301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:22.308295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:22.318206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7a42942a-a25e-4cb4-a27d-3d988e55c31c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1322 microversion: 2.1 time: 0.613986 Apr 20 18:23:22.327290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 82/170] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:21 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:22.520609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:22.530128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-70b89b05-eb58-4b9e-9ec3-39acce4d831c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.283300 Apr 20 18:23:22.530773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 89/171] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:22 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:22.748046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:22.748756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:22.757774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:22.759179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:22.760110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:22.760766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.181615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:23.191160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:23.192828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:23.193989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-216e79b5-c41c-43ea-b589-81304c678e01 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.451198 Apr 20 18:23:23.194799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 83/172] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:22 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:23.262925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:23.263592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:23.271490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.271986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.272813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.273296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.337142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:23.338399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:23.346884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.347947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.349040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.349743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.516998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:23.528190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-73d42876-3352-4b64-8646-a319eb7ea20c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.269775 Apr 20 18:23:23.530602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 90/173] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:23 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:23.548928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:23.550069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:23.558449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.559324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.560328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.561019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.798386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:23.810381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5be1dc36-2a6d-4155-9437-6781e3c6c8e1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.265566 Apr 20 18:23:23.811127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:23.811277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 91/174] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:23 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:23.825720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-658fe422-9c82-4e14-9088-142fdf4564b0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1515 microversion: 2.1 time: 0.491679 Apr 20 18:23:23.826571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 84/175] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:23 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1515 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:23.843761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:23.844918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:23.852866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.853372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.854199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:23.854719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:23.914946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lazy-loading 'flavor' on Instance uuid 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:23:24.061014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-92c18dca-309b-48ad-b132-e2ffcbaabd51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2/action" status: 200 len: 32 microversion: 2.1 time: 0.221288 Apr 20 18:23:24.061597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 92/176] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:23 2021] POST /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:24.072279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:24.072953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:24.080802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.081313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.082148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.082678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.213378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:24.214143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:24.222732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.223249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.224092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.224593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.298189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:24.308023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8d1904ae-1de1-4e92-a615-3da3a15dc5ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.240619 Apr 20 18:23:24.308635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 85/177] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:24 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:24.440715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:24.450361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:24.452065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:24.453219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f924d5e-0ad1-487c-a54c-8b5dc5b26d54 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.244458 Apr 20 18:23:24.453833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 93/178] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:24 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:24.549197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:24.549867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:24.557974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.558542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.559385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.559888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.773415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:24.783113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7e28be75-dd25-45a8-b30f-8c6ba9d2c87d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.237987 Apr 20 18:23:24.783865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 86/179] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:24 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:24.828855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:24.829523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:24.837395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.837903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:24.838770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:24.839267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:25.053805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:25.063310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-78a6299a-2165-4125-a897-b486befd372e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.238770 Apr 20 18:23:25.063925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 94/180] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:24 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:25.326111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:25.326736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:25.334651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:25.335160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:25.335988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:25.336479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:25.472906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:25.473566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:25.481927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:25.482447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:25.483490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:25.483789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:25.555247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:25.564371 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1bb1f576-bf36-4f98-a7bc-6563156e7b18 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.242466 Apr 20 18:23:25.565219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 87/181] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:25 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:25.696442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:25.705842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:25.707545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:25.708687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d2bfbbb-cc5b-438e-bb3c-4d17cb705cc3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.239912 Apr 20 18:23:25.709291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 95/182] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:25 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:23:25.801362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:25.802033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:25.810626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:25.811139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:25.811977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:25.812476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.020942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:26.030607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8a29d06-650d-4547-b806-bb4543a82989 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1317 microversion: 2.1 time: 0.233254 Apr 20 18:23:26.031227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 88/183] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:25 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:26.081063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:26.081725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:26.090220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:26.090751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.091615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:26.092086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.316098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:26.327192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d38857b1-95b4-470f-9f38-0fbbca60a523 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.249821 Apr 20 18:23:26.327799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 96/184] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:26 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:26.584008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:26.584572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:26.595651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:26.596731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.597605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:26.598110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.732075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:26.733218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:26.744554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:26.745600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.746780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:26.747425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:26.990551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:27.001697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f1ad095-915b-4ab1-82c2-1af836d53f6a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.421603 Apr 20 18:23:27.002599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 89/185] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:26 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:27.030581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:27.041889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:27.043580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:27.044832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e098c759-560f-4098-aeaa-aad3ed3c0aa0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.319210 Apr 20 18:23:27.045585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 97/186] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:26 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:27.049534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:27.050500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:27.062269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:27.062827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:27.063680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:27.064183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:27.292131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:27.301247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f3cd6fba-c2f1-4cbd-aa4c-dfbad37ed45e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1507 microversion: 2.1 time: 0.255850 Apr 20 18:23:27.301873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 90/187] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:27 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:27.345805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:27.346424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:27.354484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:27.354987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:27.355826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:27.356319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:27.570817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:27.580709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5d4251a4-31a7-4da6-859a-1c73cda7719c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.239492 Apr 20 18:23:27.581316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 98/188] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:27 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:28.018993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:28.019659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:28.027509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:28.028021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:28.028853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:28.029349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:28.063524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:28.064194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:28.072015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:28.072518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:28.073347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:28.073838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:28.244566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:28.253965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-600bc385-4935-468a-b8b3-5ccdc9f1f006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.239068 Apr 20 18:23:28.254968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 91/189] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:28 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:28.293617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:28.303097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:28.304798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:28.305988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ecfef227-8192-44e1-a0aa-aec7da4b6998 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.246593 Apr 20 18:23:28.306614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 99/190] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:28 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:28.597857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:28.598489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:28.606379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:28.606935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:28.607758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:28.608244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:28.827708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:28.836934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7eb9ffda-abfd-483f-9246-2f3b5e84c627 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.243169 Apr 20 18:23:28.837582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 92/191] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:28 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:29.271927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:29.272591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:29.280894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:29.281416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:29.282209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:29.282721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:29.325488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:29.326152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:29.334509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:29.334947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:29.336068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:29.336068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:29.503518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:29.517376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fcc758cf-0e33-472c-99b1-6c3ebf6af6bf tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.249443 Apr 20 18:23:29.517992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 100/192] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:29 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:29.562192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:29.572318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:29.574018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:29.575305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-62ce4c80-53dc-407b-b4b2-20fdcead697f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.254450 Apr 20 18:23:29.575910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 93/193] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:29 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:29.854274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:29.854964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:29.862777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:29.863284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:29.864118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:29.864650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:30.082537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:30.091382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4cbbc61e-a649-4db7-b0d6-a4a9118e2209 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.241202 Apr 20 18:23:30.091998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 101/194] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:29 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:30.538208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:30.539125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:30.548296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:30.549129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:30.550151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:30.550677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:30.594345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:30.595301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:30.611905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:30.612694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:30.613924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:30.614601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:30.876979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:30.891015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d0ef8559-e60a-4ba5-b6dd-106a046f0877 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.357962 Apr 20 18:23:30.902796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 94/195] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:30 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:31.077753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95134ff9-cb29-4aa0-b342-7edf671196b3"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:31.079144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:31.090664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:31.091203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:31.092047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:31.092583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:31.113867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:31.126386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:31.128668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:31.129904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c6b167c9-7576-4998-80f2-4b4fbb2c748c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.539753 Apr 20 18:23:31.130739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 102/196] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:30 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:31.136572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:31.137235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:31.147027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:31.147693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:31.148553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:31.149090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:31.516149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:31.526489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-189f4582-78f2-4540-b116-f7a37069d8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.394534 Apr 20 18:23:31.527120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 103/197] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:31 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:31.543407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1d438619-463d-49eb-880d-0be400ee03a4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469503 Apr 20 18:23:31.544251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 95/198] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:23:31 2021] POST /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:31.909652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:31.910241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:31.919159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:31.919996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:31.920484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:31.920990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:32.153446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:32.156384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:32.157356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:32.163664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f029792-e3c7-4b1c-9887-7d95e96ea6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.258189 Apr 20 18:23:32.164386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 104/199] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:31 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:32.167408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:32.167900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:32.169036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:32.169605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:32.407654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:32.418002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:32.419723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:32.420911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-96b8a851-e68e-4864-8f07-d3e603bc7802 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.275748 Apr 20 18:23:32.421719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 96/200] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:32 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:32.544671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:32.545457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:32.553266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:32.553972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:32.558101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:32.558630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:32.861412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:32.871986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9c8102e3-9583-4bef-acc8-51515981e411 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.331390 Apr 20 18:23:32.872716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 105/201] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:32 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:33.182784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:33.183547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:33.191860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:33.192530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:33.197250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:33.197250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:33.426894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:33.437934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f831fd5c-527e-4762-8d38-fe18b2e9ef6d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.259268 Apr 20 18:23:33.438570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 97/202] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:33 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:33.440784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:33.441522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:33.450305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:33.450914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:33.451866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:33.452442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:33.737467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:33.749727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:33.752159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:33.753704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-956468a6-bb4a-452b-badc-0b569e92ef38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.317062 Apr 20 18:23:33.753906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 106/203] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:33 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:23:33.896494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:33.897773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:33.908536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:33.909218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:33.910422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:33.911678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:34.215281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:34.224917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-34895e46-8fca-41de-b3cc-8e0604c8e316 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.332454 Apr 20 18:23:34.225641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 98/204] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:33 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:34.293821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-c7d2fb7d-03ee-45ab-b6ca-6cf22798c914 req-21ba87d5-c7ae-46b4-a7bf-f5aac8a588d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "name": "network-vif-plugged", "status": "completed", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:34.296098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:34.296098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:34.304920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c7d2fb7d-03ee-45ab-b6ca-6cf22798c914 req-21ba87d5-c7ae-46b4-a7bf-f5aac8a588d4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:34.305469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c7d2fb7d-03ee-45ab-b6ca-6cf22798c914 req-21ba87d5-c7ae-46b4-a7bf-f5aac8a588d4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:34.323089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-c7d2fb7d-03ee-45ab-b6ca-6cf22798c914 req-21ba87d5-c7ae-46b4-a7bf-f5aac8a588d4 service nova] Creating event network-vif-plugged:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:23:34.339586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-c7d2fb7d-03ee-45ab-b6ca-6cf22798c914 req-21ba87d5-c7ae-46b4-a7bf-f5aac8a588d4 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050061 Apr 20 18:23:34.340390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 107/205] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:34.457390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:34.458046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:34.469957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:34.470732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:34.471771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:34.472446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:34.775601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:34.777083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:34.787070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:34.787916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:34.789560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:34.790233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:34.929261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:34.942760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b48d8d5-5f19-4057-9c59-aa3fd687ec51 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.490085 Apr 20 18:23:34.943418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 99/206] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:34 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:35.040605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:35.081610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:35.083704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:35.088563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-786d27bf-30b6-452b-baa4-48ed1e35a83e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.319144 Apr 20 18:23:35.098657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 108/207] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:34 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:35.243688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:35.244379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:35.253623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:35.254222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:35.255158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:35.255856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:35.694845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:35.706667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-26337579-29eb-4dd5-937a-21153cb065a6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.465156 Apr 20 18:23:35.706667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 100/208] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:35 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:35.960933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:35.962131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:35.970019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:35.970546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:35.971340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:35.971816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:36.117681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:36.118341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:36.132107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:36.132611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:36.133995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:36.134512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:36.228412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:36.240849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6fde4744-41a4-4f32-b117-e48e8c5eef58 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.283615 Apr 20 18:23:36.242080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 109/209] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:35 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:36.387837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-ae8e34f7-dfef-4e66-aaef-f27f5795d95b req-364a2d92-d65f-4c51-a447-b26167f9eac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291eea25-3def-4661-bf74-4a540fedde0a", "name": "network-vif-plugged", "status": "completed", "tag": "0687950b-e993-4a24-910e-500f131bfe37"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:36.389752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:36.389752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:36.400869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ae8e34f7-dfef-4e66-aaef-f27f5795d95b req-364a2d92-d65f-4c51-a447-b26167f9eac2 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:36.401610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ae8e34f7-dfef-4e66-aaef-f27f5795d95b req-364a2d92-d65f-4c51-a447-b26167f9eac2 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:36.421128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-ae8e34f7-dfef-4e66-aaef-f27f5795d95b req-364a2d92-d65f-4c51-a447-b26167f9eac2 service nova] Creating event network-vif-plugged:0687950b-e993-4a24-910e-500f131bfe37 for instance 291eea25-3def-4661-bf74-4a540fedde0a on hv-cinder-78693 Apr 20 18:23:36.434828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-ae8e34f7-dfef-4e66-aaef-f27f5795d95b req-364a2d92-d65f-4c51-a447-b26167f9eac2 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051602 Apr 20 18:23:36.436348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 110/210] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:36.505671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:36.537549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:36.554049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:36.559467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f05fe13e-9018-48ce-90e9-e77c7bc49bb9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1408 microversion: 2.20 time: 0.442985 Apr 20 18:23:36.560491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 101/211] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:36 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:36.724492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:36.725595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:36.735079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:36.737749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:36.743234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:36.743983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:37.036347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:37.048313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f15b049-0679-44fc-b20e-592694b47d55 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.328117 Apr 20 18:23:37.049060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 111/212] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:36 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:37.260457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:37.261129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:37.271283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:37.272230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:37.274433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:37.275278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:37.568510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:37.580915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:37.581584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:37.595695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a775cff6-534a-4c28-8a8a-db59e37e47ab tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.340975 Apr 20 18:23:37.604645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:37.604645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:37.604645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:37.604645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:37.606626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 102/213] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:37 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:37.915616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:37.931029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:37.933066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:37.934571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-86d5d178-c241-47dc-925f-a7e992942b64 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1599 microversion: 2.20 time: 0.358299 Apr 20 18:23:37.935687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 112/214] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:23:37 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1599 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:37.955256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:37.955826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:37.964399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:37.965266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:37.966127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:37.966702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:38.066488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:38.067917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:38.077048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:38.077877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:38.078956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:38.079639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:38.144929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ed9ae83b-ce4c-422b-8b30-a482d3cad920 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193847 Apr 20 18:23:38.145562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 103/215] 10.222.0.22 () {60 vars in 1306 bytes} [Tue Apr 20 18:23:37 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:23:38.614770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:38.615536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:38.624733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:38.625628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:38.626258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:38.626868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:38.713600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:38.733161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3a8716be-04a3-421f-aa4a-2540fd25b2f2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1363 microversion: 2.1 time: 0.670716 Apr 20 18:23:38.734007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 113/216] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:38 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1363 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:38.921792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:38.932362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-38fb2295-a9ff-4af4-a2d7-e4f2a426bfcc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.322392 Apr 20 18:23:38.933119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 104/217] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:38 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:39.752117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:39.752646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:39.770090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:39.771090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:39.772323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:39.772966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:39.949704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:39.950674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:39.959042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:39.961381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:39.961381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:39.961381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.222328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:40.233909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e7380156-5857-41eb-82a9-6084e7657be4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.288676 Apr 20 18:23:40.234871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 105/218] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:39 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:40.280252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:40.291245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a7ab4f5a-c4d6-45ae-9d8e-91c09f0f6db1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1548 microversion: 2.1 time: 0.543494 Apr 20 18:23:40.292273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 114/219] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:39 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1548 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:40.310416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:40.311507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:40.322494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.323168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.324373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.325009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.556868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:40.558095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:40.566334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.568069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.569006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.569578 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.681934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2056e621-d1a1-41b1-a2b4-f72fa935998e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.376133 Apr 20 18:23:40.683809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 106/220] 10.222.0.22 () {58 vars in 1265 bytes} [Tue Apr 20 18:23:40 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:40.694376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-d65ba527-facc-4705-9521-53fdbb771331 req-95bb3859-b589-428b-b1a8-40a65d2ff4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:40.697770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:40.697770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:40.709811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-d65ba527-facc-4705-9521-53fdbb771331 req-95bb3859-b589-428b-b1a8-40a65d2ff4fd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.710608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-d65ba527-facc-4705-9521-53fdbb771331 req-95bb3859-b589-428b-b1a8-40a65d2ff4fd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.732621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-d65ba527-facc-4705-9521-53fdbb771331 req-95bb3859-b589-428b-b1a8-40a65d2ff4fd service nova] Creating event network-changed:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:23:40.747654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-d65ba527-facc-4705-9521-53fdbb771331 req-95bb3859-b589-428b-b1a8-40a65d2ff4fd service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061830 Apr 20 18:23:40.756882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 107/221] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:40.764723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-48812bff-9475-4d06-9ecd-3a122249696e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.211994 Apr 20 18:23:40.765988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 115/222] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:40 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:40.770000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:40.770913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:40.781102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.781870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.783613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:40.784290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:40.866752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:23:41.003997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a2349f8a-da18-465e-9886-4a6242e1a936 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "DELETE /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 204 len: 0 microversion: 2.1 time: 0.243767 Apr 20 18:23:41.005010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 108/223] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:23:40 2021] DELETE /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:23:41.015230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:41.016096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:41.025967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:41.026601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:41.027518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:41.028085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:41.253296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:41.254421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:41.266928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:41.269867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:41.270534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:41.271755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:41.272473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:41.282274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-928b2cdf-a3cc-4a1f-ae39-1428f0b9b45f tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1554 microversion: 2.1 time: 0.271615 Apr 20 18:23:41.297420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 116/224] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:41 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:41.776605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:41.778530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:41.793091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:41.796205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:41.797234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:41.797886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:42.021381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8a8d9863-7879-487d-9839-376ff52ad9b0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.248674 Apr 20 18:23:42.022097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 117/225] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:41 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:42.209571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:42.223098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-83ff0e98-a877-4068-a720-2223e0b7ac4c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.974370 Apr 20 18:23:42.228547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 109/226] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:41 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:42.307221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:42.308087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:42.324843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:42.325363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:42.326227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:42.326760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:42.708812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:42.727629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-37f4ed50-6e74-4884-b9e7-cee42f01ee19 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1554 microversion: 2.1 time: 0.425124 Apr 20 18:23:42.729148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 118/227] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:42 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1554 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:43.033050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:43.034133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:43.043983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:43.044403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:43.045398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:43.045897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:43.230161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a804143e-006e-47f6-9bff-1fbe09d4f411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.200979 Apr 20 18:23:43.230991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 110/228] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:43 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:43.246851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:43.248180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:43.257881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:43.258668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:43.260087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:43.260844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:43.657553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:43.668847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f2fa186e-3047-4f64-ab5a-7fe5bceef118 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.427274 Apr 20 18:23:43.669770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 119/229] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:43 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:43.760101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:43.761311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:43.782938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:43.786106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:43.788314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:43.790085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:43.986086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:43.987151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:44.001220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.001845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:44.006252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.006787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:44.171020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:44.184416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bcfb884f-b29f-471f-9c38-5180869b34a0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1554 microversion: 2.1 time: 0.442548 Apr 20 18:23:44.185062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 111/230] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:43 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1554 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:44.217171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-4dd5af88-b087-44a7-ae51-27a1a3506e0b req-399ba44d-e067-4c1a-a503-c7d8a265984a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291eea25-3def-4661-bf74-4a540fedde0a", "tag": "0687950b-e993-4a24-910e-500f131bfe37"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:44.217171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:44.217171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:44.227533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e37d8b4b-d6bb-4ba9-bbff-c59d918b784f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.245862 Apr 20 18:23:44.231772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 120/231] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:43 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:44.240312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-4dd5af88-b087-44a7-ae51-27a1a3506e0b req-399ba44d-e067-4c1a-a503-c7d8a265984a service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.240796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-4dd5af88-b087-44a7-ae51-27a1a3506e0b req-399ba44d-e067-4c1a-a503-c7d8a265984a service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:44.243468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:44.245557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:44.266062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.267256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:44.269301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.270880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:44.275718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-4dd5af88-b087-44a7-ae51-27a1a3506e0b req-399ba44d-e067-4c1a-a503-c7d8a265984a service nova] Creating event network-changed:0687950b-e993-4a24-910e-500f131bfe37 for instance 291eea25-3def-4661-bf74-4a540fedde0a on hv-cinder-78693 Apr 20 18:23:44.294919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-4dd5af88-b087-44a7-ae51-27a1a3506e0b req-399ba44d-e067-4c1a-a503-c7d8a265984a service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083273 Apr 20 18:23:44.295807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 112/232] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:44.515383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3707ae6a-1741-40cd-850f-16dc0b1cab98 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.277426 Apr 20 18:23:44.516232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 121/233] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:44 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:44.687621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:44.688499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:44.706071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.706743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:44.712415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:44.713079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.203494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:45.204470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:45.227871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:45.228621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.231463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:45.233783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.615159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:45.632677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-96c08e17-4f9f-42fb-a7a9-88bc74fab066 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.949905 Apr 20 18:23:45.633631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 113/234] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:44 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:45.644774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:45.646081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:45.663822 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:45.665070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.668057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:45.668879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.760818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:45.776188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-53ada874-b46f-4d35-ac0f-38cc78f4cfb0 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1554 microversion: 2.1 time: 0.577756 Apr 20 18:23:45.777158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 122/235] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:45 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1554 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:45.798661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:45.802294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:45.820152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:45.824776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.825870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:45.829208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:45.837533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ae9819c2-a0d6-4dd0-b9ce-be363e80b1ac tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.202328 Apr 20 18:23:45.843529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 114/236] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:45 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:46.029662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d5e7500c-c73f-4e37-9cfd-6cb70c69dad1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.243782 Apr 20 18:23:46.030700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 123/237] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:45 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:46.341052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-427e050c-270e-497c-bdb9-29cce63606aa req-08d735be-41e0-4d10-a9bb-30ea6ae5e04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562396b5-ebca-460e-8500-5bc2457a73b8", "name": "network-vif-deleted", "tag": "56ca2229-f046-42df-9a77-9642ea0c322e"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:46.343283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:46.343283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:46.360826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-427e050c-270e-497c-bdb9-29cce63606aa req-08d735be-41e0-4d10-a9bb-30ea6ae5e04d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.361671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-427e050c-270e-497c-bdb9-29cce63606aa req-08d735be-41e0-4d10-a9bb-30ea6ae5e04d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:46.392035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-427e050c-270e-497c-bdb9-29cce63606aa req-08d735be-41e0-4d10-a9bb-30ea6ae5e04d service nova] Creating event network-vif-deleted:56ca2229-f046-42df-9a77-9642ea0c322e for instance 562396b5-ebca-460e-8500-5bc2457a73b8 on hv-cinder-78693 Apr 20 18:23:46.397242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-427e050c-270e-497c-bdb9-29cce63606aa req-08d735be-41e0-4d10-a9bb-30ea6ae5e04d service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061284 Apr 20 18:23:46.397875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 115/238] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:46.652092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:46.652861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:46.661600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.662102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:46.662963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.663452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:46.795798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:46.797481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:46.806602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.807330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:46.820153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.821545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:46.896310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:46.908363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-816f647d-1845-4656-b552-33bb679c800c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.261274 Apr 20 18:23:46.909338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 124/239] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:46 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:46.922977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:46.924618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:46.933028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.934047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:46.935053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:46.935554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:47.000530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d92fa565948108ee28b5da019429c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812f10aeffbd4431814b5d6f985d46b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:47.010905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8b14bed7-4d3b-4094-8cce-27c5b0f36ac5 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 200 len: 1346 microversion: 2.1 time: 0.219686 Apr 20 18:23:47.011753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 116/240] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:46 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:47.041035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:47.042053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:47.049894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:47.050389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:47.053143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:47.053683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:47.124567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3566bb2d-5420-428a-80c6-b85afb631104 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.213485 Apr 20 18:23:47.125457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 125/241] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:46 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:47.299862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fcd1d4b0-de17-4438-8c8a-11d8dd957796 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.262789 Apr 20 18:23:47.303452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 117/242] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:47 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:47.928450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:47.929948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:47.941219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:47.942106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:47.943349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:47.944353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:47.955873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1683587808", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "f6c31916-db3f-4eef-ba20-4a218aa43e3d"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:48.091544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] validate_networks() for [('f6c31916-db3f-4eef-ba20-4a218aa43e3d', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:23:48.216261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:48.225419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d2551afc-9741-4c2f-8128-c164feec14a9 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.302375 Apr 20 18:23:48.233595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 126/243] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:47 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:48.249851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:48.250531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:48.258998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.259506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.260357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.260849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.314609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] HTTP exception thrown: Instance 562396b5-ebca-460e-8500-5bc2457a73b8 could not be found. Apr 20 18:23:48.315284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Returning 404 to user: Instance 562396b5-ebca-460e-8500-5bc2457a73b8 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:23:48.316196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ed691a5f-adf2-4229-b769-04bd633dfb87 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 404 len: 111 microversion: 2.1 time: 0.089046 Apr 20 18:23:48.320063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 127/244] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:48 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:23:48.322588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:48.323634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:48.333252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.333252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.333252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.333473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.491618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ab6afcc9-917d-4e6b-8615-e863c502f3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.173351 Apr 20 18:23:48.493750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 128/245] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:48 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:48.502072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:48.503514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:48.515107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.516195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.517180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.517902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.684191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-30dad370-8e88-4b57-b180-b6dcaac30de9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.188593 Apr 20 18:23:48.685652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 129/246] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:48 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:48.707253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:23:48.707976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:23:48.708647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:23:48.709247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:23:48.710018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:23:48.719651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.720255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.721227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:48.721912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:48.761420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:23:48.766261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for user d0c2f29521f34fc0bf8356872818be71 and project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:23:48.779050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:23:48.782158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:23:48.841214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-391f7c07-0772-40e7-acf6-3b5668b0881b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889839 Apr 20 18:23:48.842679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 118/247] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:23:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:23:48.854329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-68f28acb-bc08-4894-89dc-3d2ca982124b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:48.855146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-68f28acb-bc08-4894-89dc-3d2ca982124b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:48.953278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-68f28acb-bc08-4894-89dc-3d2ca982124b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:48.962328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-68f28acb-bc08-4894-89dc-3d2ca982124b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1218 microversion: 2.1 time: 0.112990 Apr 20 18:23:48.962971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 130/248] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:48 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:49.244577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:49.245360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:49.254879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.255655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.256497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.257126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.481100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:49.490225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bf034b82-9d14-4388-93e4-00ddbfc2ab44 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.250506 Apr 20 18:23:49.490881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 119/249] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:49 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:49.504434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:49.505480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:49.528924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.529439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.530306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.530834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.696327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:49.697444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:49.705222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.705725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.706574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.707065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.710263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-96808e39-c6ee-40d1-9ae5-a48a2714bc58 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.209582 Apr 20 18:23:49.711747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 131/250] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:49 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:49.851038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d64053db-b980-4dd5-a406-163f218ed3b5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.159124 Apr 20 18:23:49.851902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 120/251] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:49 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:49.935795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:49.936446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:49.945609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.946129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.947018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.947514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.981218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:49.984215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:49.993499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.994215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:49.995119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:49.995620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:50.000803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] HTTP exception thrown: Instance 562396b5-ebca-460e-8500-5bc2457a73b8 could not be found. Apr 20 18:23:50.001472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Returning 404 to user: Instance 562396b5-ebca-460e-8500-5bc2457a73b8 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:23:50.002380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-30282026-5176-48be-a94e-66f3463c58eb tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "DELETE /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 404 len: 111 microversion: 2.1 time: 0.071207 Apr 20 18:23:50.003203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 132/252] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:23:49 2021] DELETE /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:23:50.011804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:50.012626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] [instance: 562396b5-ebca-460e-8500-5bc2457a73b8] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:50.020651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:50.021312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:50.022295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:50.022969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:50.078818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] HTTP exception thrown: Instance 562396b5-ebca-460e-8500-5bc2457a73b8 could not be found. Apr 20 18:23:50.079858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] Returning 404 to user: Instance 562396b5-ebca-460e-8500-5bc2457a73b8 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:23:50.081046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f08c71a9-21c2-4e1c-bf73-7b3275a5da45 tempest-DeleteServersTestJSON-1566410725 tempest-DeleteServersTestJSON-1566410725-project] 10.222.0.22 "GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8" status: 404 len: 111 microversion: 2.1 time: 0.073747 Apr 20 18:23:50.081825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 133/253] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:50 2021] GET /compute/v2.1/servers/562396b5-ebca-460e-8500-5bc2457a73b8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:23:50.151979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:50.162048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-168b5685-e859-4c94-a63a-7402ef7f7b9c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1270 microversion: 2.1 time: 0.185183 Apr 20 18:23:50.163315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 121/254] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:49 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:50.510521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:50.511647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:50.520556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:50.521582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:50.522682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:50.524191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:50.723056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:50.724416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:50.743889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:50.748824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:50.749997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:50.750705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:51.011994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dc834e92-ac93-457f-b3a2-9e821d82b1f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.293380 Apr 20 18:23:51.015034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 122/255] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:50 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:51.021994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:51.025339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:51.045408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:51.047648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:51.048527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:51.049034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:51.264287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d9eeffce-c393-482d-a4a3-161ba3a2a81a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.246844 Apr 20 18:23:51.268316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 123/256] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:51 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:51.271708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:51.272476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:51.281392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:51.281895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:51.282768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:51.283271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:51.390422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:51.399522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fe344b36-b111-4bfb-aeb3-38c497cc0b15 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.895223 Apr 20 18:23:51.404401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 134/257] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:50 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:51.412381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:51.422239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9ae5af9d-52e7-4ae1-ace4-89fb9dcd0877 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1276 microversion: 2.1 time: 0.155505 Apr 20 18:23:51.423108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 124/258] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:51 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:52.027735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:52.030453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:52.041174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.041758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.042698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.044080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.211898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b47b3d97-a8b8-47da-8778-6ba662130681 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.190018 Apr 20 18:23:52.212929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 135/259] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:52 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:52.276028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:52.277129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:52.292215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.296430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.297559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.298067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.419034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:52.424873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:52.447269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.448061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.450033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.454692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.551125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fccf08bd-2491-4fb9-9db2-38d3255c6094 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.279102 Apr 20 18:23:52.551965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 125/260] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:52 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:52.557724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:52.558512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:52.580118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.580809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.581952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.582694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:52.951699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:52.964004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-59b08451-b67b-4562-b698-120e6dde8b53 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.549527 Apr 20 18:23:52.975706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 136/261] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:52 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:52.982276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-089b439c-32fe-4be8-98a7-65f6454ed502 req-017e8903-2b69-4f2d-8eba-fb0b5abe75b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757b937a-0306-40da-8edb-2ccd83f641cb", "tag": "d7110f76-a2e0-49fe-8734-f2f940cbb445"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:52.984101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:23:52.984101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:23:52.996234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-089b439c-32fe-4be8-98a7-65f6454ed502 req-017e8903-2b69-4f2d-8eba-fb0b5abe75b2 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:52.997209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-089b439c-32fe-4be8-98a7-65f6454ed502 req-017e8903-2b69-4f2d-8eba-fb0b5abe75b2 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:53.015759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-089b439c-32fe-4be8-98a7-65f6454ed502 req-017e8903-2b69-4f2d-8eba-fb0b5abe75b2 service nova] Creating event network-changed:d7110f76-a2e0-49fe-8734-f2f940cbb445 for instance 757b937a-0306-40da-8edb-2ccd83f641cb on hv-cinder-78693 Apr 20 18:23:53.022439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-089b439c-32fe-4be8-98a7-65f6454ed502 req-017e8903-2b69-4f2d-8eba-fb0b5abe75b2 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044528 Apr 20 18:23:53.023962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 137/262] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:23:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:53.127556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:53.146289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8f1241d-7569-47ce-8160-157f14377e9d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.593199 Apr 20 18:23:53.147294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 126/263] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:52 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:53.225214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:53.227233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:53.244376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:53.245845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:53.246814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:53.248758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:53.458101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e5de0759-28e1-42a9-aa65-c90726f7c13a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.237591 Apr 20 18:23:53.460124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 138/264] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:53 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:53.565310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:53.566627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:53.581981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:53.582900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:53.587029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:53.587533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:53.798548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9903c6c2-f17a-41ff-8e7e-9287d12ca578 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.238827 Apr 20 18:23:53.799602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 127/265] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:53 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:53.982838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:53.983273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:53.998411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:53.998967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:53.999818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.000310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:54.166221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:54.167707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:54.178156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.178863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:54.180080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.180747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:54.388467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:54.401426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cc340b23-bdf3-4f95-85b2-835fdf022713 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.423270 Apr 20 18:23:54.402694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 139/266] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:53 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:54.472007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:54.473050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:54.486430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.486966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:54.495932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.496657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:54.669623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-311f64b8-eae7-4f70-bc1e-c53ca1fdb3eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.201483 Apr 20 18:23:54.672911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 140/267] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:54 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:23:54.701568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:54.742872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2b49ac3b-3404-459a-8dd1-523f09725e8e tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.551683 Apr 20 18:23:54.754208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 128/268] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:54 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:54.824912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:54.827112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:54.836459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.837609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:54.838699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:54.839410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.025816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f6a18a89-3fcb-425d-96d3-7335a4914a45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.218992 Apr 20 18:23:55.029802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 141/269] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:54 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:55.420640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:55.421310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:55.432960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:55.433463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.434299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:55.435277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.685537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:55.692093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:55.700847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:55.707561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:55.708186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.709522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:55.712026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e227a8d7-5d8d-4fc1-aae3-a6d8cfb7d0ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.295382 Apr 20 18:23:55.712888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 129/270] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:55 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:55.725226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.762453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:55.763491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:55.772923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:55.774276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.775779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:55.777141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:55.891540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-307e579b-b839-4ac1-92f3-24230f703ad9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.214068 Apr 20 18:23:55.893047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 142/271] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:55 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:23:56.037611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:56.038788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:56.040771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:56.047176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a3c13fc8-5d94-439f-9159-683490ccc1e3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.289814 Apr 20 18:23:56.054687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:56.054687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:56.054687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:56.054687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:56.055853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 130/272] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:55 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:56.201986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c0faf3fd-749f-4fd0-a6a3-e3e82c27c023 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 14 microversion: 2.20 time: 0.167796 Apr 20 18:23:56.205545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 143/273] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:56 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:56.729626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:56.730397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:56.738827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:56.739459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:56.740361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:56.740994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:56.904902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:56.906367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:56.915671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:56.916180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:56.917093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:56.917607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:57.062902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-df682a63-fb71-4d78-9eee-262613db2294 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 14 microversion: 2.1 time: 0.162391 Apr 20 18:23:57.063965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 144/274] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:56 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:23:57.070657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:57.071920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:57.081701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:57.082625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:57.084063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:57.084962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:57.371481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:57.384859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a14b4380-9a49-4e5d-ab72-6434172634ea tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.659376 Apr 20 18:23:57.385978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 131/275] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:56 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:57.391140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:57.392648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:57.401414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:57.401932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:57.402924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:57.403421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:57.434166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:57.450358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9050118f-cea5-4991-b518-ba2b8fc17f98 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.384842 Apr 20 18:23:57.451188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 145/276] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:57 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:57.589349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-10c7736e-e8d1-4f88-90c8-736ac86513c1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 9751 microversion: 2.20 time: 0.201655 Apr 20 18:23:57.591004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 132/277] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:57 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 9751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:23:58.075201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:58.076954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:58.090189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.090955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.092039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.092731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.253556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-db6a5b9d-3deb-40ea-a21e-f3d61ce9b808 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 4107 microversion: 2.1 time: 0.182134 Apr 20 18:23:58.254676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 146/278] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:58 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 4107 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:58.404334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:58.404954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:58.421113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.421634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.422513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.423010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.469293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:58.470142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:58.480817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.481410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.482328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.483637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.794625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:58.814603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ce2a756f-76f6-4741-8c58-7a1601520d53 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.348910 Apr 20 18:23:58.816698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 147/279] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:58 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:23:58.844675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:58.846099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:58.863158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.866118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.867289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:58.869408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:58.895360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:23:58.909399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-86e24c5a-4979-428e-8a80-5cdc726c5bd7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.509667 Apr 20 18:23:58.914304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 133/280] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:58 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:23:59.073904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1469650e-3445-44ad-b191-30b14302db39 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 15064 microversion: 2.20 time: 0.255380 Apr 20 18:23:59.075359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 148/281] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:23:58 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 15064 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:23:59.265674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:23:59.266725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:59.274956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:59.275663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:59.276671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:59.277311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:59.466584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-546c30e6-3033-40bb-acb6-9e387ece2969 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 11258 microversion: 2.1 time: 0.182148 Apr 20 18:23:59.467708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 134/282] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:23:59 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 11258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:23:59.834616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:59.836187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:59.844766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:59.845279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:59.846108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:59.846916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:59.932087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:59.932781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:23:59.941629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:59.942138 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:23:59.943007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:23:59.943506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:00.199072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:00.213326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-287ed167-4801-40e2-92ea-b8f664f591ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.285559 Apr 20 18:24:00.214833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 135/283] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:59 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:00.230750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:00.233474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:00.245448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:00.246242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:00.248003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:00.248655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:00.451005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bb8d04e6-14be-4827-be16-02b9402db5a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 17861 microversion: 2.20 time: 0.223252 Apr 20 18:24:00.451936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 136/284] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:00 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 17861 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:00.463917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-1e501050-bdb2-4359-8b8d-4eff26c3c30a req-45f784da-f101-4b2d-a22e-578a6e9b9c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757b937a-0306-40da-8edb-2ccd83f641cb", "name": "network-vif-plugged", "status": "completed", "tag": "d7110f76-a2e0-49fe-8734-f2f940cbb445"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:00.466891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:00.466891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:24:00.480641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1e501050-bdb2-4359-8b8d-4eff26c3c30a req-45f784da-f101-4b2d-a22e-578a6e9b9c0d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:00.481939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1e501050-bdb2-4359-8b8d-4eff26c3c30a req-45f784da-f101-4b2d-a22e-578a6e9b9c0d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:00.508173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-1e501050-bdb2-4359-8b8d-4eff26c3c30a req-45f784da-f101-4b2d-a22e-578a6e9b9c0d service nova] Creating event network-vif-plugged:d7110f76-a2e0-49fe-8734-f2f940cbb445 for instance 757b937a-0306-40da-8edb-2ccd83f641cb on hv-cinder-78693 Apr 20 18:24:00.516601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:00.523872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-1e501050-bdb2-4359-8b8d-4eff26c3c30a req-45f784da-f101-4b2d-a22e-578a6e9b9c0d service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068677 Apr 20 18:24:00.527753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8b182f5a-8aa5-4169-83e7-6422a5a1079a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.697201 Apr 20 18:24:00.528317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 149/286] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:23:59 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:00.528742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 137/286] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:24:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:00.535492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:00.536945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:00.545580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:00.546249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:00.547534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:00.548304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:00.763229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b6124571-67bd-424b-9e26-b2cf5f93d2af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 16319 microversion: 2.1 time: 0.232735 Apr 20 18:24:00.767519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 150/287] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:00 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 16319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:01.234490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:01.235926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:01.246499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.247228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.248572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.249512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.464848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:01.465898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:01.474369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.475101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.475947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.477055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.644904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-16ff72cd-d87e-402c-bc71-1e4b5096170d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 19342 microversion: 2.20 time: 0.184978 Apr 20 18:24:01.646633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 151/288] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:01 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 19342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:01.653982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:01.654959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:01.667507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.668021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.669861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.670655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.784883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:01.803006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bebd74c4-77ed-4e8e-99bb-5607d5f6b6ed tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.573563 Apr 20 18:24:01.808987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 138/289] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:01 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:01.820684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:01.826342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:01.843158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.844071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.845082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:01.846454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:01.935647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:01.945517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-349d09c2-0842-4fea-b2ba-4b2d17500911 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1318 microversion: 2.1 time: 0.297619 Apr 20 18:24:01.946348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 152/290] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:01 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:02.015800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f4c60cfa-c891-4312-9adf-c816a91488b7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 18305 microversion: 2.1 time: 0.205389 Apr 20 18:24:02.016610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 139/291] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:01 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 18305 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:02.661149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:02.664142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:02.675809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:02.676324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:02.677156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:02.677646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:02.822084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:02.822993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:02.832193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:02.832704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:02.833560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:02.834062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:02.849497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-54e7742f-26ad-4894-8b38-724f894298de tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 20985 microversion: 2.20 time: 0.195484 Apr 20 18:24:02.850372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 153/292] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:02 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 20985 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:02.966004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:02.967026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:02.975760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:02.976945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:02.977860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:02.978443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.122265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:03.131919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-843467dc-96b3-4275-96ae-35e81b7d353e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.314848 Apr 20 18:24:03.133082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 140/293] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:02 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:03.137920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:03.138962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:03.146621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.147134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.148607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.149109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.292590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91dbebc6-c384-4377-8759-e9948285eaa4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 19446 microversion: 2.1 time: 0.158104 Apr 20 18:24:03.296569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 141/294] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:03 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 19446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:03.296809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:03.305979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-430f7829-47b4-4048-a3a1-44ec75483283 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1508 microversion: 2.1 time: 0.345176 Apr 20 18:24:03.306653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 154/295] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:02 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:03.326404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95134ff9-cb29-4aa0-b342-7edf671196b3"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:03.328067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:03.338402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.338939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.339792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.340295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.529821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] HTTP exception thrown: Invalid volume: volume 95134ff9-cb29-4aa0-b342-7edf671196b3 is already attached to instances: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed Apr 20 18:24:03.529821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Returning 400 to user: Invalid volume: volume 95134ff9-cb29-4aa0-b342-7edf671196b3 is already attached to instances: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:24:03.529821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1699c20c-abc5-4459-b673-cafbb1c717d8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206369 Apr 20 18:24:03.529821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 142/296] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:24:03 2021] POST /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:24:03.645910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:03.646756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:03.656045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.656976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.658024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.658734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.864023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:03.865755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:03.880670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.882320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.884070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:03.884762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:03.900898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lazy-loading 'services' on Instance uuid d1f9d529-91fc-49e7-9140-ed7acdd0b2ed {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:24:04.105002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-97026180-5d71-426f-84fb-1707a69b05ea tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed/os-volume_attachments/95134ff9-cb29-4aa0-b342-7edf671196b3" status: 202 len: 0 microversion: 2.1 time: 0.464342 Apr 20 18:24:04.105724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 155/297] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:24:03 2021] DELETE /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed/os-volume_attachments/95134ff9-cb29-4aa0-b342-7edf671196b3 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:04.108402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b427ea5-a59c-42eb-92d3-2e3391140c3f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 22704 microversion: 2.20 time: 0.249571 Apr 20 18:24:04.110360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 143/298] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:03 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 22704 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:04.150211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:04.150973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:04.160268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:04.161796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:04.162849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:04.164050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:04.307716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:04.309066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:04.319006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:04.319963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:04.321002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:04.321687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:04.504764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:04.514212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-09e19336-790f-4d37-9951-9754e91b85fc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.368489 Apr 20 18:24:04.514885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 156/299] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:04 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:05.121673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:05.122942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:05.131059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:05.131678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:05.132657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:05.133229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:07.190770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d41697fb-82cf-4c33-816b-7145c586adbd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 24113 microversion: 2.1 time: 2.888945 Apr 20 18:24:07.192444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 144/300] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:04 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 24113 bytes in 2892 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:07.198724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:07.199485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:07.207835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:07.208350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:07.209186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:07.209687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:07.219398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6f27368d-75bb-463c-8dd4-b0fd07bd5db0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 24773 microversion: 2.20 time: 2.101630 Apr 20 18:24:07.221031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 157/301] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:05 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 24773 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:07.432107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:07.441081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b4dbdba0-55dd-4979-a5cc-b54d65cfbffb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.247341 Apr 20 18:24:07.441630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 145/302] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:07 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:08.203997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:08.205654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:08.216663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:08.217647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:08.218682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:08.219484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:08.233529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:08.234650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:08.249745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:08.250259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:08.252192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:08.252696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:08.420445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-184d8d35-dfc0-463c-b718-a473451923c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 25017 microversion: 2.1 time: 0.220664 Apr 20 18:24:08.421595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 158/303] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:08 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 25017 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:08.460854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:08.461741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:08.472151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:08.472784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:08.473764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:08.474368 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:08.495238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4f400d4b-710e-44c0-a3aa-4e9ee5e4b75f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 25701 microversion: 2.20 time: 0.267144 Apr 20 18:24:08.495920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 146/304] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:08 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 25701 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:08.739219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:08.754280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6dddbf39-9389-4eaa-82ec-386095229682 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.298840 Apr 20 18:24:08.755516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 159/305] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:08 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:08.911961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-288610963", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "f6c31916-db3f-4eef-ba20-4a218aa43e3d"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:08.995823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] validate_networks() for [('f6c31916-db3f-4eef-ba20-4a218aa43e3d', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:24:09.433946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:09.435183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:09.443082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.443588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.444433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.444923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.657014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:24:09.657490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:24:09.658038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:24:09.658577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:24:09.659040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:24:09.671214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.671669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.672591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.673089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.692244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:24:09.696788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for user d0c2f29521f34fc0bf8356872818be71 and project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:24:09.711422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:24:09.711566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:24:09.761193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-18ee5214-71eb-4464-89e1-1ed38c039824 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854407 Apr 20 18:24:09.768442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 147/306] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:24:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:24:09.768442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:09.768442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:09.775530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9994d7a6-1178-48f1-9e1d-6ab587e13a1c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 26032 microversion: 2.1 time: 0.346154 Apr 20 18:24:09.776439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 160/307] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:09 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 26032 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:24:09.778141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.778646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.779515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.780004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.782660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:09.783587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:09.794416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.795112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.796091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:09.797161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:09.942169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ca867a7f-bd3f-4deb-bc06-26e46c197301 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 26516 microversion: 2.20 time: 0.178636 Apr 20 18:24:09.943741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 148/308] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:09 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 26516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:09.951525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce25f75b-7cd8-4860-bbc3-763c501f1941 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:09.952293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ce25f75b-7cd8-4860-bbc3-763c501f1941 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:10.027230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:10.033439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ce25f75b-7cd8-4860-bbc3-763c501f1941 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:10.038945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5aee0d3e-d716-4088-aeb9-b55536bfb5e8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1521 microversion: 2.1 time: 0.260798 Apr 20 18:24:10.040074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 161/309] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:09 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:10.046251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ce25f75b-7cd8-4860-bbc3-763c501f1941 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1217 microversion: 2.1 time: 0.101913 Apr 20 18:24:10.047346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 149/310] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:09 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:10.789778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:10.791573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:10.813167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:10.813890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:10.814963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:10.815606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:10.955493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:10.956963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:10.972200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:10.977291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:10.978282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:10.979267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.007456 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-19863add-2a69-4ce4-a1b2-cdcc5a027081 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 26686 microversion: 2.1 time: 0.223206 Apr 20 18:24:11.012596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 162/311] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:10 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 26686 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:11.067173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:11.068108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:11.081915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:11.082424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.083291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:11.083782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.144216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-df8b8899-544e-491a-a91a-407e9c9f338a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 27033 microversion: 2.20 time: 0.191583 Apr 20 18:24:11.145949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 150/312] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:10 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 27033 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:11.155944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:11.156833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:11.166762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:11.167549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.168532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:11.169353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.346825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:11.349013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:11.357971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-791d95f1-ac11-4bc2-b62d-a56da4398006 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1501 microversion: 2.1 time: 0.297287 Apr 20 18:24:11.359206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 163/313] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:11 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:11.360685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-34ee15b2-bc99-444f-b01e-e3cfefaf7407 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1269 microversion: 2.1 time: 0.211636 Apr 20 18:24:11.361604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 151/314] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:11 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:11.377219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:11.377921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:11.387350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:11.387855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.388700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:11.389192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:11.881956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:11.892104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-df06acb7-06c2-4752-a0fc-ef9022df3953 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1514 microversion: 2.1 time: 0.519320 Apr 20 18:24:11.893740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 164/315] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:11 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1514 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:12.023034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:12.024792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:12.035047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:12.036440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:12.037507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:12.039407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:12.160617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:12.162652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:12.176697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:12.177369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:12.179712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:12.180305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:12.245232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8d79c4bd-23fb-45ba-a0f7-5cbad983f706 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 27396 microversion: 2.1 time: 0.228245 Apr 20 18:24:12.250188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 152/316] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:12 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 27396 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:12.380142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:12.380916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:12.389606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ed743f36-f4fa-4088-87aa-fe0a67710185 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 27432 microversion: 2.20 time: 0.234585 Apr 20 18:24:12.390975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 165/317] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:12 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 27432 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:12.406323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:12.407134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:12.408117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:12.408758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:12.661738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:12.671803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-29e6a23d-e054-4a64-8e6c-b771c6444129 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1275 microversion: 2.1 time: 0.296537 Apr 20 18:24:12.672431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 153/318] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:12 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:13.259882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:13.260946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:13.269511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.270018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.270885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.271380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.402419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:13.403511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:13.414184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.414721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.415584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.416261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.438430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6f03d0c2-c475-4e12-be94-9bc3788e8402 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 27679 microversion: 2.1 time: 0.183699 Apr 20 18:24:13.439159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 166/319] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:13 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 27679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:13.586221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91eac528-5024-4798-8cf5-ce40b63a25c5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 27671 microversion: 2.20 time: 0.188038 Apr 20 18:24:13.587064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 154/320] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:13 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 27671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:13.691171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:13.692353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:13.705000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.705896 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.707178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.707757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.744029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:13.745691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:13.767139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.767920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.769031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:13.772567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:13.872739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lazy-loading 'flavor' on Instance uuid 888724ad-feda-4539-a72f-4c20f18b223d {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:24:14.001648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:14.012875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c70bbd69-f014-4bf0-9aca-c77e8a09009a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.327067 Apr 20 18:24:14.013808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 167/321] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:13 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:14.044933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-51cd4f19-d4e4-4b28-9725-dc7c155841eb req-d1cf5f61-d682-4fce-8a02-518047a19f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f7830e2-cffc-40b0-8ddf-07d5735038b5", "tag": "5f1fe119-73f4-487d-94c6-c39e1fb10d46"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:14.050230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e763350b-8372-4823-8042-0924e292a1c4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action" status: 200 len: 32 microversion: 2.1 time: 0.311508 Apr 20 18:24:14.051116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 155/322] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:13 2021] POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:24:14.058985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:14.058985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:24:14.068588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-51cd4f19-d4e4-4b28-9725-dc7c155841eb req-d1cf5f61-d682-4fce-8a02-518047a19f08 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.069095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-51cd4f19-d4e4-4b28-9725-dc7c155841eb req-d1cf5f61-d682-4fce-8a02-518047a19f08 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.071129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:14.071903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:14.080749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.081251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.082096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.083327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.087411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-51cd4f19-d4e4-4b28-9725-dc7c155841eb req-d1cf5f61-d682-4fce-8a02-518047a19f08 service nova] Creating event network-changed:5f1fe119-73f4-487d-94c6-c39e1fb10d46 for instance 9f7830e2-cffc-40b0-8ddf-07d5735038b5 on hv-cinder-78693 Apr 20 18:24:14.101608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-51cd4f19-d4e4-4b28-9725-dc7c155841eb req-d1cf5f61-d682-4fce-8a02-518047a19f08 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060130 Apr 20 18:24:14.102671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 168/323] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:24:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:24:14.451754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:14.453004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:14.461194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.461709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.462719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.463215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.622034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1a984b1c-588c-4b60-9041-3719d84c3419 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 27961 microversion: 2.1 time: 0.174771 Apr 20 18:24:14.622779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 169/324] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:14 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 27961 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:14.628669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:14.629977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:14.639466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.641269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.642190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:14.642732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:14.787611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c98163c-c5ce-4d85-a24e-d25175fb485b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 27913 microversion: 2.20 time: 0.162953 Apr 20 18:24:14.789279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 170/325] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:14 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 27913 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:14.873187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:14.882752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2a961fe1-fc80-48ec-bf84-91e8ad08c44f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.816649 Apr 20 18:24:14.883359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 156/326] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:14 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:15.034250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:15.035372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:15.058589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.059100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.060048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.060584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.280137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:15.289524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5c67bc05-ff3e-4b31-8aac-afed62b1ac36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.261996 Apr 20 18:24:15.290405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 171/327] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:15 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:15.636013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:15.637078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:15.645199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.645700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.646555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.647042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.795485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ff95e11d-212a-4219-b8a6-2b1c15b44150 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28150 microversion: 2.1 time: 0.163484 Apr 20 18:24:15.798158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 157/328] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:15 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28150 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:15.801440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:15.802496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:15.810871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.811378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.812215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.812713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.901675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:15.902500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:15.911389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.911901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.912742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:15.913767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:15.962028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f25d379b-5408-47d3-bbaf-d7d561a3d3dc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28149 microversion: 2.20 time: 0.164399 Apr 20 18:24:15.963024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 172/329] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:15 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28149 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:16.307548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:16.308366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:16.309419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:16.318020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:16.318552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:16.319278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbf47686-80a3-4569-9694-e8b25f5a3b7a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.422112 Apr 20 18:24:16.319400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:16.319876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:16.330334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 158/330] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:15 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:16.559045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:16.568274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f21507d8-e39c-42a7-b4f5-447a5cf58084 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.265323 Apr 20 18:24:16.568894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 173/331] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:16 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:16.807435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:16.808591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:16.816476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:16.817062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:16.817962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:16.818361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:16.953675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2e30c851-8757-41db-983c-913475cd7c98 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28150 microversion: 2.1 time: 0.150266 Apr 20 18:24:16.954380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 159/332] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:16 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28150 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:16.973586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:16.974740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:16.982525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:16.983035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:16.983948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:16.984443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:17.128517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-08e493e5-ac02-4db9-b058-34d8fbc8b056 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28149 microversion: 2.20 time: 0.158794 Apr 20 18:24:17.129265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 174/333] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:16 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28149 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:17.338092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:17.338889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:17.348095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:17.348595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:17.349416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:17.349903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:17.565925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:17.574934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ade39ae-4005-4095-8540-4d93693d0157 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.241276 Apr 20 18:24:17.575550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 160/334] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:17 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:17.587093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:17.587871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:17.596530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:17.597041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:17.597886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:17.598379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:17.812833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:17.821670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d3072849-e281-48fd-b298-df4efa5d902b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.239331 Apr 20 18:24:17.822285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 175/335] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:17 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:17.966769 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:17.967965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:17.976844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:17.977465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:17.978290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:17.978805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:18.129738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c30ba6c7-365b-4e16-ba3e-fac80a03513f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28345 microversion: 2.1 time: 0.166781 Apr 20 18:24:18.130493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 161/336] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:17 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:18.141611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:18.142688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:18.151305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:18.151809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:18.152630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:18.153095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:18.309392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-86af5e42-b782-4192-86d7-365f464d6686 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28440 microversion: 2.20 time: 0.171731 Apr 20 18:24:18.310193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 176/337] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:18 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28440 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:18.594068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:18.594875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:18.603449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:18.603960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:18.604803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:18.605307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:18.828446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:18.837610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-462d4caf-049e-4d36-abe9-842764b34581 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.248071 Apr 20 18:24:18.838516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 162/338] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:18 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:18.839632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:18.840512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:18.849236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:18.849683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:18.851065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:18.851556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:19.076051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:19.084868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-380d0da7-24e5-46ec-be59-8adbde12268c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.250019 Apr 20 18:24:19.085485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 177/339] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:18 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:19.142976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:19.144086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:19.152344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:19.152861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:19.153712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:19.154211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:19.321201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:19.322239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:19.326597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-66ad11f3-8075-459e-842e-f90191c8a900 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28441 microversion: 2.1 time: 0.188699 Apr 20 18:24:19.327521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 163/340] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:19 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28441 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:19.331116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:19.331625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:19.332461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:19.332951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:19.478210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dcf7fea1-2ce3-4a1a-8ff8-e6d35a58cda1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28440 microversion: 2.20 time: 0.160873 Apr 20 18:24:19.479314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 178/341] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:19 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28440 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:19.856283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:19.857040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:19.865801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:19.866309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:19.867162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:19.867679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.084296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:20.093169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2da3f9f8-cad1-4e97-8b13-72c741a83eaa tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.241377 Apr 20 18:24:20.093781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 164/342] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:19 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:20.103501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:20.104269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:20.112865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:20.113376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.114209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:20.114736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.338913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:20.339960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:20.348465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:20.349258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.351094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:20.351792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.354374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:20.365327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c55ffe13-2eb5-4d5b-a888-4c76fb098daa tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.266228 Apr 20 18:24:20.366006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 179/343] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:20 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:20.489685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:20.490980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:20.499354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:20.499860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.500680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:20.501330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:20.507800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-604aac6c-ca38-4204-b7c6-1524dbd5821e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28606 microversion: 2.1 time: 0.172313 Apr 20 18:24:20.513426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 165/344] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:20 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28606 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:20.661378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6dd284a6-5c5f-4191-a6da-ca9b549a0413 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 0.175216 Apr 20 18:24:20.662206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 180/345] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:20 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:21.111783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:21.112734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:21.121933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.122428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.123280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.123768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.349314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:21.358667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3157c48a-af45-4ca0-97f8-095cd7d3a906 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.251436 Apr 20 18:24:21.359276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 166/346] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:21 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:21.385671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:21.386440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:21.394978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.395492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.396325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.396821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.520020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:21.521070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:21.529949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.530511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.531365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.531867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.613139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:21.621954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b07c1704-5256-4011-98cc-791a8e842630 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.240750 Apr 20 18:24:21.622588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 181/347] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:21 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:21.673264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:21.674287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:21.681895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.682402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:21.683259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:21.683753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:24.351476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4d5f534b-0a1a-4dbe-b1ba-cdf800ede030 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28606 microversion: 2.1 time: 2.834731 Apr 20 18:24:24.352174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 167/348] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:21 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28606 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:24.357952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:24.358759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:24.368035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:24.368547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:24.369383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:24.369936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:24.376796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fc746f69-a43b-4ce4-a8ae-3840b584f566 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 2.707102 Apr 20 18:24:24.381043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 182/349] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:21 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:24.383220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:24.384190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:24.392969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:24.393485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:24.394368 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:24.394924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:24.586269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:24.595387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-98856311-4d64-433a-9c4f-e1c0c6699d46 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.241773 Apr 20 18:24:24.596011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 168/350] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:24 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:24.613532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:24.622409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f5e74274-18f9-4bea-a3f8-68c09f8c2458 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.243625 Apr 20 18:24:24.623066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 183/351] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:24 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:25.363801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:25.364967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:25.373413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.373917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.374844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.375331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.389643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:25.391470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:25.402149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.403308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.405276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.406078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.539898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b37db103-837a-43be-a047-dffef0d746a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28606 microversion: 2.1 time: 0.179872 Apr 20 18:24:25.540955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 169/352] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:25 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28606 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:25.575944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f67f47e9-e642-4bba-ba53-e68e5f341109 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 0.190584 Apr 20 18:24:25.576704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 184/353] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:25 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:25.614296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:25.615156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:25.624850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.625355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.626263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.626788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.641842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:25.642644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:25.655924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.655924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.655924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:25.655924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:25.870092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:25.879134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2969e5ee-3cec-426d-8cfd-1b1495155bff tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.269642 Apr 20 18:24:25.879737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 170/354] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:25 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:25.899647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:25.908486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eb4ef827-b014-451e-90ca-752d76d3fa7c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.271837 Apr 20 18:24:25.909114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 185/355] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:25 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:26.476949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-80882a71-f7a9-4db6-9522-584d856b1402 req-dc92ee73-b143-4d58-8c16-6a100070cb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f7830e2-cffc-40b0-8ddf-07d5735038b5", "name": "network-vif-plugged", "status": "completed", "tag": "5f1fe119-73f4-487d-94c6-c39e1fb10d46"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:26.478685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:26.478685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:24:26.488004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-80882a71-f7a9-4db6-9522-584d856b1402 req-dc92ee73-b143-4d58-8c16-6a100070cb84 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.488507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-80882a71-f7a9-4db6-9522-584d856b1402 req-dc92ee73-b143-4d58-8c16-6a100070cb84 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.510165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-80882a71-f7a9-4db6-9522-584d856b1402 req-dc92ee73-b143-4d58-8c16-6a100070cb84 service nova] Creating event network-vif-plugged:5f1fe119-73f4-487d-94c6-c39e1fb10d46 for instance 9f7830e2-cffc-40b0-8ddf-07d5735038b5 on hv-cinder-78693 Apr 20 18:24:26.515780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-80882a71-f7a9-4db6-9522-584d856b1402 req-dc92ee73-b143-4d58-8c16-6a100070cb84 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044683 Apr 20 18:24:26.516693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 171/356] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:24:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:26.552810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:26.554198 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:26.564021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.564536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.565419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.566199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.589820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:26.591204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:26.603682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.604195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.605050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.605547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.741870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-72eed191-8d25-4804-8a7c-dcd1b21a4201 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28606 microversion: 2.1 time: 0.192559 Apr 20 18:24:26.742604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 186/357] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:26 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28606 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:26.783641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1a7adef2-f428-42a9-adf2-b1c83f1bbc9b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 0.198869 Apr 20 18:24:26.784329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 172/358] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:26 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:26.898276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:26.899343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:26.908080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.908593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.909443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.910057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.928983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:26.930207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:26.939389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.939899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:26.940757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:26.941259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:27.153223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:27.163796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-378f00c8-d418-4757-b145-073e322a985b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.268795 Apr 20 18:24:27.163972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 187/359] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:26 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:27.191423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:27.201709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bead2974-035c-463b-956f-42cfa92a54d4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.277975 Apr 20 18:24:27.202798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 173/360] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:26 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:27.754437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:27.756454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:27.766104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:27.766964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:27.768145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:27.768782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:27.797002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:27.798086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:27.814657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:27.815165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:27.816010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:27.816504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:27.939730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d6788c05-a84e-49f6-8970-c5a837d5bcbe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28606 microversion: 2.1 time: 0.189585 Apr 20 18:24:27.940595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 188/361] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:27 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28606 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:28.004041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a6e9efa5-7143-4737-8c54-7a20db0c918c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 0.211314 Apr 20 18:24:28.005186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 174/362] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:27 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:28.181945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:28.182985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:28.192026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:28.192763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:28.193690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:28.194825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:28.219994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:28.220856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:28.229690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:28.230196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:28.231102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:28.231591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:28.418173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:28.427580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-120cd49e-45f2-42f6-a215-492cce51b19b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.250561 Apr 20 18:24:28.428966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 189/363] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:28 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:28.773006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:28.797418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9be96c66-81ad-4cc1-a578-ddb3d69ca2b5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1317 microversion: 2.1 time: 0.582014 Apr 20 18:24:28.798435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 175/364] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:28 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:28.953099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:28.954119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:28.962986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:28.963710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:28.965023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:28.965619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:29.018816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:29.019876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:29.030059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:29.030981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:29.031905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:29.032547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:29.106680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a31fc903-21ec-460d-bb61-cb4273ec84d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 28606 microversion: 2.1 time: 0.157416 Apr 20 18:24:29.108406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 190/365] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:28 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 28606 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:29.165575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-51f1be34-2887-4fbe-bd83-7bae4a18ca81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 0.151633 Apr 20 18:24:29.167278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 176/366] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:29 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:29.447092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:29.448025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:29.456513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:29.457011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:29.457831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:29.458315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:29.674935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:29.683758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-71b4ad56-0def-4aca-b65a-995b7e584bad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.241665 Apr 20 18:24:29.684370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 191/367] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:29 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:29.817086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:29.817852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:29.827386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:29.827861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:29.828693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:29.829185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.067679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:30.077825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-33b9c299-95cc-4fb8-a443-9e3ca618947c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1508 microversion: 2.1 time: 0.265380 Apr 20 18:24:30.078628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 177/368] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:29 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:30.121253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:30.122298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:30.132068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:30.135015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.136079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:30.136913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.178906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:30.180471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:30.198211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:30.198644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.199678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:30.200214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.309476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-33959f4d-4992-4f49-abcf-b0f8e85bb314 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 30130 microversion: 2.1 time: 0.193495 Apr 20 18:24:30.311662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 192/369] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:30 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 30130 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:24:30.382515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ee85f07-c723-4949-9633-44abb2beaf58 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 28608 microversion: 2.20 time: 0.208481 Apr 20 18:24:30.383570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 178/370] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:30 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 28608 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:30.702036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:30.702893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:30.712079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:30.712592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.713433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:30.713987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:30.933134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:30.942200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-742353d9-998d-457d-9422-31975b5c76c2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.244759 Apr 20 18:24:30.942853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 193/371] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:30 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:31.325876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:31.327062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:31.335596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.336309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.337100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.337586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.396730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:31.397923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:31.416446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.417024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.417848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.418335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.507764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9d4b61c7-7012-4e50-9af4-ddc51ea05742 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 31376 microversion: 2.1 time: 0.186242 Apr 20 18:24:31.509918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 179/372] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:31 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 31376 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:31.601953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ea235275-269a-459d-95e7-00cd5ea68bdc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 29722 microversion: 2.20 time: 0.210344 Apr 20 18:24:31.603460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 194/373] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:31 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 29722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:31.794727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3485f3dc-10c1-4e15-b99c-44c100706524"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:31.796102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:31.805799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.806366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.807639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.808149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.962668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:31.963446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:31.978489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.979291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:31.979838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:31.980327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:32.223925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:32.233996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d0c9980b-73c7-4b29-b1b4-664f52ce14ae tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.276791 Apr 20 18:24:32.234845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 195/374] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:31 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:32.263265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-81a46cb1-a1f2-4b96-bd2b-8ea64e82f7b1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472854 Apr 20 18:24:32.264139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 180/375] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:24:31 2021] POST /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:32.534889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:32.536866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:32.545673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:32.546537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:32.547679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:32.548169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:32.617710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:32.619143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:32.633473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:32.634311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:32.635383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:32.636088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:32.705983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c63641d4-a6e6-431f-ae1e-63b275cbe9ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 32271 microversion: 2.1 time: 0.190355 Apr 20 18:24:32.706714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 196/376] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:32 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 32271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:32.783765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c44fdbb-d6f3-41a3-839a-14686fc86e0d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 30824 microversion: 2.20 time: 0.173748 Apr 20 18:24:32.784683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 181/377] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:32 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 30824 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:33.253004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:33.254083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:33.263217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:33.263729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:33.264566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:33.265069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:33.503002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:33.512823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f529d89d-fa47-43ee-ac25-56189d34f96c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.264325 Apr 20 18:24:33.513474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 197/378] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:33 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:33.719658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:33.720799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:33.733076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:33.733820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:33.735140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:33.735902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:33.795861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:33.796795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:33.808042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:33.814748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:33.816541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:33.817037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:33.911235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c6d68d44-2b5c-4caa-bf51-b3819782dada tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 33027 microversion: 2.1 time: 0.195601 Apr 20 18:24:33.911959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 182/379] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:33 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 33027 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:34.006004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a8f25407-338c-4067-87ee-597cbfd59e44 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 32052 microversion: 2.20 time: 0.214005 Apr 20 18:24:34.010337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 198/380] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:33 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 32052 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:34.530752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:34.531524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:34.540984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:34.541491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:34.542314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:34.542849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:34.752217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:34.761759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-13139dd8-4939-4ae2-a249-5c9b51f89e8a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.235723 Apr 20 18:24:34.762597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 183/381] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:34 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:34.925098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:34.926222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:34.935278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:34.935790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:34.936641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:34.937144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:35.018297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:35.019407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:35.027874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:35.028380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:35.029209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:35.029698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:35.099048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-02cd9446-dbe3-4da0-a7c1-9f413ac2f4a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 33530 microversion: 2.1 time: 0.178262 Apr 20 18:24:35.099749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 199/382] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:34 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 33530 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:35.196593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-24b24dfe-82b4-484a-93f6-0bb3713bdeeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 32922 microversion: 2.20 time: 0.181860 Apr 20 18:24:35.197222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 184/383] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:35 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 32922 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:35.780603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:35.781290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:35.790648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:35.791161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:35.792000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:35.792487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:36.026698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:36.040951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-af6a362e-8615-41b5-b0a2-5d9ad42234d5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.264850 Apr 20 18:24:36.041646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 200/384] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:35 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:36.112288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:36.113620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:36.122304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:36.122878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:36.123708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:36.124196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:36.209079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:36.210228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:36.218647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:36.219157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:36.220096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:36.220593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:36.294299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c82bb3c1-c6c8-4e59-8f66-6fff594a4804 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 34195 microversion: 2.1 time: 0.186271 Apr 20 18:24:36.295211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 185/385] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:36 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 34195 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:36.521160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e2ba1211-0e0f-4db5-a046-06f76ecc8f2c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 33391 microversion: 2.20 time: 0.314887 Apr 20 18:24:36.521160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 201/386] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:36 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 33391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:37.059520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:37.060275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:37.069304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:37.069810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:37.070653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:37.071140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:37.297149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:37.306147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2069b247-0493-47e9-bd2a-daf9a2f05913 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.251248 Apr 20 18:24:37.306818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 186/387] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:37 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:37.307878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:37.309015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:37.317813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:37.318267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:37.319178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:37.320213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:37.491098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f503afd2-37cd-44a6-a478-6fee8cc6c3bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 34888 microversion: 2.1 time: 0.187453 Apr 20 18:24:37.492419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 202/388] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:37 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 34888 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:37.532535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:37.533589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:37.542754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:37.543270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:37.544102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:37.544599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:37.698160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-13009a88-80b8-4f99-8e1d-a1164e7d85eb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 33868 microversion: 2.20 time: 0.169548 Apr 20 18:24:37.698931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 187/389] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:37 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 33868 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:38.327307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:38.328076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:38.337672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:38.338143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:38.339020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:38.339523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:38.504916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:38.506065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:38.515805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:38.516330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:38.517177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:38.517660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:38.558276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:38.567802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5cc0eb03-c593-4db6-ae4e-6ccc8763e657 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.244893 Apr 20 18:24:38.568534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 203/390] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:38 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:38.710632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:38.711685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:38.719522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:38.720038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:38.720881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:38.721379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:38.752035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fa422252-f8fe-4cae-bb71-63fecd76a5a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 35616 microversion: 2.1 time: 0.251338 Apr 20 18:24:38.756709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 188/391] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:38 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 35616 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:24:38.915285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ced45c92-628e-417f-a05d-0f970a4efc06 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 34593 microversion: 2.20 time: 0.208919 Apr 20 18:24:38.915979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 204/392] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:38 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 34593 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:39.587172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:39.587938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:39.596404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:39.596919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:39.597751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:39.598246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:39.778565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:39.783692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:39.812517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:39.813024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:39.813876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:39.814365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:39.870390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:39.880878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b3a4ec14-52af-484e-9978-a0c595b1ab2e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.298719 Apr 20 18:24:39.885379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 189/393] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:39 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:39.927876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:39.928886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:39.937914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:39.938433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:39.939325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:39.939845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:40.033913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f16efdcc-f9a1-4139-9197-0a71c2b74268 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 36156 microversion: 2.1 time: 0.269103 Apr 20 18:24:40.035468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 205/394] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:39 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 36156 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:40.119348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6a7aa501-3817-42aa-9dc6-47b4b7630ec8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 34988 microversion: 2.20 time: 0.195009 Apr 20 18:24:40.120037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 190/395] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:39 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 34988 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:40.135261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3485f3dc-10c1-4e15-b99c-44c100706524"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:40.136527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:40.144737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:40.145282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:40.146103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:40.146618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:40.324492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] HTTP exception thrown: Invalid volume: volume 3485f3dc-10c1-4e15-b99c-44c100706524 is already attached to instances: 9f7830e2-cffc-40b0-8ddf-07d5735038b5 Apr 20 18:24:40.325164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Returning 400 to user: Invalid volume: volume 3485f3dc-10c1-4e15-b99c-44c100706524 is already attached to instances: 9f7830e2-cffc-40b0-8ddf-07d5735038b5 {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:24:40.326069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4294a91b-bff1-463d-8b55-a0ffb31d87f3 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196085 Apr 20 18:24:40.326702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 206/396] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:24:40 2021] POST /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:24:40.444389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:40.445555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:40.454820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:40.455578 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:40.456429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:40.457034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:40.636030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lazy-loading 'services' on Instance uuid 9f7830e2-cffc-40b0-8ddf-07d5735038b5 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:24:40.786231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3c916e90-bcd2-401c-bf85-28fa6d7c866c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5/os-volume_attachments/3485f3dc-10c1-4e15-b99c-44c100706524" status: 202 len: 0 microversion: 2.1 time: 0.346043 Apr 20 18:24:40.787188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 191/397] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:24:40 2021] DELETE /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5/os-volume_attachments/3485f3dc-10c1-4e15-b99c-44c100706524 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:40.906335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:40.907359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:40.920035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:40.920557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:40.921454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:40.922075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.047948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:41.049193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:41.058341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.058908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.059754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.060310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.137920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:41.147382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f8fe6ca-045a-47de-ae6a-9a25d33a9227 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1500 microversion: 2.1 time: 0.247375 Apr 20 18:24:41.148565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 207/398] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:40 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1500 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:41.153388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:41.154488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:41.162790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.163331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.164183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.164669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.223964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76bd9d80-0eff-493b-b5af-a072804a76ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 36964 microversion: 2.1 time: 0.180053 Apr 20 18:24:41.224873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 192/399] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:41 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 36964 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:41.230577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "605e1b0d-f920-4e54-aeac-160ad9e4c0ec"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:41.231848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:41.240414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.240919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.241760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.242256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.305110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] HTTP exception thrown: Cannot 'attach_volume' instance 888724ad-feda-4539-a72f-4c20f18b223d while it is in vm_state rescued Apr 20 18:24:41.305774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Returning 409 to user: Cannot 'attach_volume' instance 888724ad-feda-4539-a72f-4c20f18b223d while it is in vm_state rescued {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:24:41.306732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c4602307-61a3-4fc0-91b3-156e0e4077c8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080679 Apr 20 18:24:41.307346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 193/400] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:24:41 2021] POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 18:24:41.316028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:41.316619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:41.324729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.325239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.326070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.326588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.363534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3a6b5730-c42b-412d-bc9f-eb8ce1df2791 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 35707 microversion: 2.20 time: 0.213531 Apr 20 18:24:41.365187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 208/401] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:41 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 35707 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:41.471483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8b9f6869-d3e5-426b-9777-18ff7532b4f2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action" status: 202 len: 0 microversion: 2.1 time: 0.158944 Apr 20 18:24:41.472144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 194/402] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:41 2021] POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:41.481449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:41.482213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:41.490764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.491276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.492671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:41.493170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:41.738643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:41.749364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e3e52614-6359-4be1-8c39-c7fc3ac6d51b tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1508 microversion: 2.1 time: 0.272333 Apr 20 18:24:41.750331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 209/403] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:41 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:42.236438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:42.237585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:42.247000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:42.247514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:42.248362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:42.248871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:42.376902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:42.377948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:42.386331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:42.386871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:42.387721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:42.388220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:42.409789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c737f1c9-f8e3-4a64-8fdd-768aeb1ca10f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 37781 microversion: 2.1 time: 0.177652 Apr 20 18:24:42.410655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 195/404] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:42 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 37781 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:42.615049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b0f8a232-5c0f-4a66-81b4-79cfa0d5045c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 36528 microversion: 2.20 time: 0.241986 Apr 20 18:24:42.615729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 210/405] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:42 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 36528 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:42.769118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:42.769888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:42.778493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:42.779020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:42.779855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:42.780351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.003627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:43.012600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2a0fd86f-6625-42c1-87c1-1e70c1043284 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1508 microversion: 2.1 time: 0.248009 Apr 20 18:24:43.013403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 196/406] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:42 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:43.248501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-298738508", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "f6c31916-db3f-4eef-ba20-4a218aa43e3d"}]}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:43.322781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] validate_networks() for [('f6c31916-db3f-4eef-ba20-4a218aa43e3d', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:24:43.423378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:43.424397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:43.432481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:43.432996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.433837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:43.434337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.584682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1266bb2c-bed1-4f56-807d-ecdbf25b60b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 38098 microversion: 2.1 time: 0.165442 Apr 20 18:24:43.586444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 197/407] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:43 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 38098 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:24:43.628731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:43.630015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:43.639246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:43.639779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.640608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:43.641155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.804617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-80e02e05-f6cf-4214-b138-0093876cb121 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 37082 microversion: 2.20 time: 0.179476 Apr 20 18:24:43.814614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 198/408] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:43 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 37082 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:24:43.895833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:24:43.896304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:24:43.896841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:24:43.897295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Image pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:24:43.897784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:24:43.906666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:43.907175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.908029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:43.908513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:43.926855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:24:43.931557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Getting quotas for user d0c2f29521f34fc0bf8356872818be71 and project 3980f2cb8d974b599823aa8a320628ad. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:24:43.942454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Going to run 1 instances... {{(pid=100569) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:24:43.945727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100569) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:24:43.999295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8c37810f-7042-4e02-a675-70f520ddb0c6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754657 Apr 20 18:24:43.999295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 211/409] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:24:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:24:44.011159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b7a9e9bd-7db1-4cf1-afe4-2426a0b784ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:44.011985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b7a9e9bd-7db1-4cf1-afe4-2426a0b784ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:44.031596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:44.032551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:44.042177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:44.042732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:44.043579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:44.044079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:44.092330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b7a9e9bd-7db1-4cf1-afe4-2426a0b784ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:44.102202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b7a9e9bd-7db1-4cf1-afe4-2426a0b784ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1217 microversion: 2.1 time: 0.096162 Apr 20 18:24:44.110518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 199/410] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:44 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:44.476511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:44.488852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-79c1e6f9-7399-4031-b741-9ef988e05c09 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1508 microversion: 2.1 time: 0.461183 Apr 20 18:24:44.489518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 212/411] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:44 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:44.597544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:44.598607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:44.607935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:44.608454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:44.609298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:44.609793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:44.783414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fb4c1eff-ba81-4365-81da-605e4c2dbd3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 38220 microversion: 2.1 time: 0.189633 Apr 20 18:24:44.784224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 200/412] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:44 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 38220 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:44.818087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:44.825483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:44.848146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:44.848653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:44.849508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:44.850015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:45.049460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1d4b8bee-63af-4907-a892-54b99420a013 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 37863 microversion: 2.20 time: 0.235630 Apr 20 18:24:45.050081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 213/413] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:44 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 37863 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:45.122170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:45.123308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:45.132788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:45.133408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:45.134568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:45.135209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:45.272186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:45.281935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9520fbf0-41a4-4cc6-8d26-c1290bd9c90c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1269 microversion: 2.1 time: 0.165257 Apr 20 18:24:45.282577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 201/414] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:45 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:45.511387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:45.513079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:45.524391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:45.524893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:45.525785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:45.526680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:45.747004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:45.758421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3eebf342-8d38-47dd-9340-f0fb5c468872 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1514 microversion: 2.1 time: 0.254323 Apr 20 18:24:45.759092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 214/415] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:45 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:45.796709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:45.798249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:45.809415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:45.810190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:45.811332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:45.812053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.009609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-976841bc-592f-47b6-805d-020f3990dc63 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 200 len: 38228 microversion: 2.1 time: 0.216726 Apr 20 18:24:46.010443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 202/416] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:45 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 38228 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:46.021785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:46.022321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:46.038708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:46.039211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.040058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:46.040548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.072414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:46.073847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:46.084159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:46.085117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.086427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:46.087274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.162018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4dc52150-3e83-4585-881a-76aa342a6cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/ips" status: 200 len: 145 microversion: 2.1 time: 0.144213 Apr 20 18:24:46.166666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 215/417] 10.222.0.22 () {58 vars in 1238 bytes} [Tue Apr 20 18:24:46 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/ips => generated 145 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:46.272747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5220cf2a-3e0e-4883-8450-de7ecbb27be0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 38134 microversion: 2.20 time: 0.206339 Apr 20 18:24:46.273559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 203/418] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:46 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 38134 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:46.302361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:46.303070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:46.330738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:46.331250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.336846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:46.337538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:46.477597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:46.486757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8bb4e8ea-0967-4134-9450-7becf3c0b794 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1275 microversion: 2.1 time: 0.189137 Apr 20 18:24:46.487721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 216/419] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:46 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:47.286824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:47.289448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:47.298193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.298970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.299970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.300635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.479750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:47.480410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:47.494664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.494866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-51b3d4ee-ce29-4218-a3d5-de7492b1c19f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 200 len: 38271 microversion: 2.20 time: 0.212731 Apr 20 18:24:47.495170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.495997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 204/420] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:47 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 38271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:24:47.496106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.496498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.508924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:47.511073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:47.521711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.522222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.523643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.524140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.900517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:47.911350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7c6375fd-9be4-417d-aaf0-5ccea4a940b1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1514 microversion: 2.1 time: 0.435534 Apr 20 18:24:47.912448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 217/421] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:47 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:47.918891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:47.919434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:47.939297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.939803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:47.945572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:47.947592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:48.028003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-baaa09a2-17ad-44b9-9d42-a59a9b9990f5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/ips" status: 200 len: 151 microversion: 2.20 time: 0.114276 Apr 20 18:24:48.028939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 218/422] 10.222.0.22 () {60 vars in 1279 bytes} [Tue Apr 20 18:24:47 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/ips => generated 151 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:48.037551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fab263-3a61-49ec-8c76-74dc9b2584b7"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:48.038867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:48.048464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:48.048980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:48.049840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:48.050336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:48.157103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:48.168103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76f63ebe-c899-4074-a526-242ce644f0e8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.666520 Apr 20 18:24:48.173439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 205/423] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:47 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:48.460980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-392a8ddf-ee9c-4fc9-9ac4-19d43afade5b req-f1daa131-8fb9-4dcd-88d5-4bde1b5b1bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e5ef7b-60f5-4bcb-8f61-f99be17af818", "tag": "f12fc086-057c-44a7-adb3-c0465ad70c4c"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:48.462849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:48.462849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:24:48.477918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-392a8ddf-ee9c-4fc9-9ac4-19d43afade5b req-f1daa131-8fb9-4dcd-88d5-4bde1b5b1bc6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:48.478651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-392a8ddf-ee9c-4fc9-9ac4-19d43afade5b req-f1daa131-8fb9-4dcd-88d5-4bde1b5b1bc6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:48.501137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-392a8ddf-ee9c-4fc9-9ac4-19d43afade5b req-f1daa131-8fb9-4dcd-88d5-4bde1b5b1bc6 service nova] Creating event network-changed:f12fc086-057c-44a7-adb3-c0465ad70c4c for instance a2e5ef7b-60f5-4bcb-8f61-f99be17af818 on hv-cinder-78693 Apr 20 18:24:48.507085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-392a8ddf-ee9c-4fc9-9ac4-19d43afade5b req-f1daa131-8fb9-4dcd-88d5-4bde1b5b1bc6 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050477 Apr 20 18:24:48.507922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 206/424] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:24:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:24:48.553624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e8c8fa13-afca-4759-9cdb-c3b63e7f1a5f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521472 Apr 20 18:24:48.555682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 219/425] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:24:48 2021] POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:49.185628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d2ce98-a83c-41a2-9527-e16930250eb6"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:49.186871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:49.190029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:49.190876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:49.195558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:49.196072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:49.196915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:49.197405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:49.202486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:49.203014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:49.204002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:49.204336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:49.449064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:49.459090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5b4bb99a-a2c0-45ce-adf3-4ffb9ad8d3ff tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.273655 Apr 20 18:24:49.459709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 220/426] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:49 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:50.126228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-66ee9b95-0dac-4ce0-a926-385c2b21048c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946089 Apr 20 18:24:50.126957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 207/427] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:24:49 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:50.478499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:50.479190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:50.486985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:50.487489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:50.488323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:50.488814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:50.702171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:50.711924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5904825f-7bd6-4ddb-a068-3cf9310061b4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.238080 Apr 20 18:24:50.712580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 221/428] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:50 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:50.931695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:50.932381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:50.941073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:50.941590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:50.942435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:50.942960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:51.002106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lazy-loading 'flavor' on Instance uuid 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:24:51.363235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7e2bd07b-c02d-4f85-bdbb-aab2e8045f38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 202 len: 0 microversion: 2.20 time: 0.436366 Apr 20 18:24:51.364322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 208/429] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:24:50 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:24:51.373237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:51.383529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:51.392616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:51.393213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:51.394243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:51.394835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:51.617564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:51.627171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:51.628848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:51.630067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5232bc10-deec-42a1-93b4-bc7ddc4a9969 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.260989 Apr 20 18:24:51.630713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 222/430] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:51 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:24:51.730912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:51.731762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:51.740723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:51.741812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:51.742863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:51.743595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:51.971681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:51.981226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dcd73425-8297-4869-b8a2-908980c2bdd5 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.255578 Apr 20 18:24:51.981827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 209/431] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:51 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:52.651385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:52.652065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:52.659977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:52.660457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:52.661574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:52.662070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:52.887609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:52.897141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:52.899403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:52.900635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-225e227d-fa08-43b3-8f66-30e12af06932 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.253918 Apr 20 18:24:52.901250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 223/432] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:52 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:24:52.999719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:53.000316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:53.009241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:53.009756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:53.010620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:53.011180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:53.232719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:53.242919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-64cea20d-f774-46e0-a52e-d8351779dbde tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.246966 Apr 20 18:24:53.253092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 210/433] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:52 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:53.921702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:53.922375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:53.940261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:53.940771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:53.941643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:53.942085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:54.157419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:54.171600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:54.173531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:54.174848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7894bdbf-8654-4582-989a-80771cf62777 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.257444 Apr 20 18:24:54.175982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 224/434] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:53 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:24:54.261136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:54.261851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:54.269707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:54.270209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:54.271114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:54.271552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:54.495189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:54.504443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a496aac6-c7da-4a07-bf41-0f944f5bcd75 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.247488 Apr 20 18:24:54.505046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 211/435] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:54 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:55.195047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:55.195695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:55.203643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:55.204149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:55.205048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:55.205450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:55.422770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:55.432903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:55.434876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:55.436363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0e336a1c-9f08-4db3-b0cc-c862e38c139f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.245970 Apr 20 18:24:55.437070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 225/436] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:55 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:24:55.523392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:55.524281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:55.532616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:55.533120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:55.533956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:55.534438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:55.776179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:55.785336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bf0fa217-b001-430f-8114-0b9efb1e4a6f tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.266024 Apr 20 18:24:55.786619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 212/437] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:55 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:56.457576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:56.458606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:56.467618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.468329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:56.469818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.470436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:56.690646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:56.692045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:56.701393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.702150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:56.703226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.703881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:56.742750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:56.757880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:56.769911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:56.771387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8a9f8bdf-f3a4-4e77-b1ae-3a6acba5c713 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.319544 Apr 20 18:24:56.783793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 226/438] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:56 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:24:56.798754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-c5deb7e0-ecb9-4dda-b7ce-46fd1637a613 req-98ff3dfb-f4c0-48a5-a6ca-d8365da9f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e5ef7b-60f5-4bcb-8f61-f99be17af818", "name": "network-vif-plugged", "status": "completed", "tag": "f12fc086-057c-44a7-adb3-c0465ad70c4c"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:56.800695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:56.800695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:24:56.809847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lazy-loading 'flavor' on Instance uuid 888724ad-feda-4539-a72f-4c20f18b223d {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:24:56.831899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c5deb7e0-ecb9-4dda-b7ce-46fd1637a613 req-98ff3dfb-f4c0-48a5-a6ca-d8365da9f1c1 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.833336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c5deb7e0-ecb9-4dda-b7ce-46fd1637a613 req-98ff3dfb-f4c0-48a5-a6ca-d8365da9f1c1 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:56.870805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-c5deb7e0-ecb9-4dda-b7ce-46fd1637a613 req-98ff3dfb-f4c0-48a5-a6ca-d8365da9f1c1 service nova] Creating event network-vif-plugged:f12fc086-057c-44a7-adb3-c0465ad70c4c for instance a2e5ef7b-60f5-4bcb-8f61-f99be17af818 on hv-cinder-78693 Apr 20 18:24:56.876929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-c5deb7e0-ecb9-4dda-b7ce-46fd1637a613 req-98ff3dfb-f4c0-48a5-a6ca-d8365da9f1c1 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091354 Apr 20 18:24:56.877727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 227/439] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:24:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:56.883671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:56.884434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:56.892780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.893304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:56.894549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:56.894927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:57.141536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1425d3a3-cc31-4c47-9cd9-92d51de5940d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action" status: 200 len: 32 microversion: 2.1 time: 0.455086 Apr 20 18:24:57.143731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 213/440] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:24:56 2021] POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action => generated 32 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:24:57.152948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:57.153851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:57.163717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:57.164389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:57.165372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:57.165977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:57.195024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:57.208188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f6156ae0-22df-46f4-beff-e4e894ac5e6c tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.328965 Apr 20 18:24:57.209177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 228/441] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:56 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:57.750516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:57.761852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bcd6855a-2204-410f-abde-083f7bfa2403 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.613226 Apr 20 18:24:57.762793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 214/442] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:57 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:24:57.807787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:57.808447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:57.830196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:57.830735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:57.835248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:57.835737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:58.135451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:58.147655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:58.149979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:58.152150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0292412b-2210-4da0-a6b0-4d1a6fad92b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.348544 Apr 20 18:24:58.153205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 229/443] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:57 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:24:58.228192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:58.229172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:58.247093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:58.251973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:58.252936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:58.253757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:58.746684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:58.755920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3b2f3d1a-15ba-4b14-9955-23fe0e553906 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1317 microversion: 2.1 time: 0.532745 Apr 20 18:24:58.757068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 215/444] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:58 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:58.781141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:58.782314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:58.792453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:58.793175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:58.794180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:58.794906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:59.171542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:59.172214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:59.180485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:59.180976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:59.181802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:59.182648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:59.192105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:59.203282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f23bd7b-4243-426b-9744-a80b8e2ffc40 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.426894 Apr 20 18:24:59.204206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 230/445] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:58 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:59.449004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:59.460357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:59.462085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:24:59.463543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e0cd090f-ceb4-44bf-b0ee-bf7feece0862 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.296169 Apr 20 18:24:59.475826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 216/446] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:24:59 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:24:59.773704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:59.774314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:24:59.782661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:59.783176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:24:59.784012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:24:59.784520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:00.009730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:00.018744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-71b7762e-2d83-40ec-98ae-c403d1dc8046 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1508 microversion: 2.1 time: 0.249352 Apr 20 18:25:00.019682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 231/447] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:24:59 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:00.223150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:00.223824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:00.232934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:00.233610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:00.234451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:00.234977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:00.473695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:00.483834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7e233998-88f5-4f0a-90f6-b2397591332d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.265354 Apr 20 18:25:00.484003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:00.484448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 217/448] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:00 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:00.484558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:00.492869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:00.493510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:00.494345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:00.494865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:00.707950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:00.717450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:00.719207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:00.720427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-09231749-6296-450e-be8a-b096e9043a9c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.240601 Apr 20 18:25:00.721024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 232/449] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:00 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:25:01.502218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:01.502857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:01.511582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:01.512095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:01.512937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:01.513433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:01.563720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac08528-0223-4c25-811a-1fe2c6b9d77f"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:01.565009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:01.573643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:01.574157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:01.575015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:01.575514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:01.736809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:01.748388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fe5172b7-17c4-43e6-a4de-1e3600d18401 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.250248 Apr 20 18:25:01.749077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 218/450] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:01 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:01.754052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:01.754685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:01.763170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:01.763662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:01.764676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:01.765321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:01.986834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:01.991734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a2f5a0c7-58e1-4f10-a4b9-a009bf3499e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "POST /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431390 Apr 20 18:25:01.992697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 233/451] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:25:01 2021] POST /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:02.000405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:02.002110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:02.003409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c6355ca1-c414-4799-b070-c08e8b9ed473 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.253320 Apr 20 18:25:02.015311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 219/452] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:01 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:02.768127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:02.769430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:02.778752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:02.779261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:02.780071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:02.780716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:03.002232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:03.012003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-12beb382-3bad-4d48-b3a9-49fbb99f869c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.248357 Apr 20 18:25:03.012618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 234/453] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:02 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:03.023814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:03.024299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:03.032603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:03.033315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:03.034155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:03.034983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:03.410168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:03.421172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:03.422911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:03.424082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e84d942d-5dc4-4b36-bdc5-a2c3cfb6706c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.404999 Apr 20 18:25:03.424900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 220/454] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:03 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:03.573563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-51390241-9cee-4fb4-a4c2-dd93457e5fc0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:03.581447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51390241-9cee-4fb4-a4c2-dd93457e5fc0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:03.582223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51390241-9cee-4fb4-a4c2-dd93457e5fc0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:03.643291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-51390241-9cee-4fb4-a4c2-dd93457e5fc0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Going to try to stop instance {{(pid=100569) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 18:25:03.719185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-51390241-9cee-4fb4-a4c2-dd93457e5fc0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 202 len: 0 microversion: 2.1 time: 0.149680 Apr 20 18:25:03.719912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 235/455] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:25:03 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:25:03.728732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:03.729618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:03.738795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:03.739463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:03.740312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:03.740779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:03.959683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:03.969716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e1eaf9f8-8554-4e17-9fe8-e8cad7350583 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.245433 Apr 20 18:25:03.970325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 221/456] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:03 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:04.030609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:04.031382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:04.040433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:04.040951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:04.041794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:04.042294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:04.274869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:04.285104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-524a440f-dc48-4f67-a730-0a916284f62d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.259090 Apr 20 18:25:04.285716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 236/457] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:04 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:04.445129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:04.445958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:04.454454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:04.455128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:04.456071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:04.456672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:04.688934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:04.699917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:04.701794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:04.703169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d250b9ba-5168-4f7c-99e2-8caac19c5d45 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.262909 Apr 20 18:25:04.703944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 222/458] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:04 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:04.988941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:04.989659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:04.998720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:04.999236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:05.000076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:05.000568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:05.217933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:05.228201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-136479fa-0edf-4f59-9ff2-5b89ba7e00a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.243349 Apr 20 18:25:05.228761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 237/459] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:04 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:05.303448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:05.304655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:05.319400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:05.319888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:05.320843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:05.321357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:05.565043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:05.574348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f8fe1a7-d512-4ead-9d77-e19a75f15f9f tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.275023 Apr 20 18:25:05.574984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 223/460] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:05 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:05.723611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:05.724266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:05.732046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:05.732541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:05.733360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:05.733844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:05.949077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:05.958590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:05.960851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:05.962083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-533238e8-b8f5-464e-8e81-81f35d2adc0e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.242586 Apr 20 18:25:05.962730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 238/461] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:05 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:06.247174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:06.247936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:06.255691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.256190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.257638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.258128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.468624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:06.478576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fd4327a7-d106-4094-b185-7878f23bc60c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.235386 Apr 20 18:25:06.479191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 224/462] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:06 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:06.592261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:06.592932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:06.601401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.601902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.602755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.603250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.629123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-326447135", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:06.702005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] validate_networks() for None {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:25:06.821326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:06.831049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-631e6606-8d96-4eb8-a1ec-c16d23ffc4bd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.242956 Apr 20 18:25:06.831675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 239/463] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:06 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:06.982410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:06.983102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:06.986683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:25:06.987164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:25:06.987706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:25:06.988178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:25:06.988624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:25:06.991030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.991536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.992376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.992869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.997563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.998071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:06.998980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:06.999474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:07.017685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Getting quotas for project 531ce5185679425eaddb154d9ad70128. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:25:07.022025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Getting quotas for user 716f7aa54e7440119cb9bac3b8c4e2b0 and project 531ce5185679425eaddb154d9ad70128. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:25:07.033776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:25:07.036658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:25:07.085823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f0d05edc-3653-4fe2-ae55-1bd1db3748de tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.460222 Apr 20 18:25:07.086540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 225/464] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:25:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 18:25:07.096875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b543fe35-a19c-4882-80d1-55186dfa86f6 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:07.097547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b543fe35-a19c-4882-80d1-55186dfa86f6 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:07.177452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b543fe35-a19c-4882-80d1-55186dfa86f6 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:07.192297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b543fe35-a19c-4882-80d1-55186dfa86f6 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1214 microversion: 2.1 time: 0.099067 Apr 20 18:25:07.193026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 226/465] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:07 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:07.220338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:07.230355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:07.232075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:07.233355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3dd79bb8-30e3-4e8e-bc75-fa66eedad3f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.255196 Apr 20 18:25:07.234055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 240/466] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:06 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:25:07.497503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:07.498131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:07.506163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:07.507242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:07.508097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:07.508797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:07.743831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:07.755785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a4d8f323-430c-408b-8503-f716b3b75a00 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.262860 Apr 20 18:25:07.771111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 227/467] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:07 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:07.849113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:07.849784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:07.857813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:07.858323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:07.859199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:07.859699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:08.068943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:08.078427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-054633da-7227-48d5-9a29-23363b2f5b73 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.233507 Apr 20 18:25:08.079099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 241/468] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:07 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:08.211123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:08.211922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:08.219750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:08.220249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:08.221069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:08.221557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:08.253308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:08.254083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:08.261954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:08.262483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:08.263341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:08.263841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:08.349642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:08.359305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-20c9a222-90cf-478b-bac3-e37b614ffa4b tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1266 microversion: 2.1 time: 0.152407 Apr 20 18:25:08.359924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 228/469] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:08 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:08.479508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:08.489181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:08.490902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:08.492182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b377a0a7-05b4-4384-b03c-07ee0fd9e942 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1745 microversion: 2.20 time: 0.243040 Apr 20 18:25:08.492911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 242/470] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:08 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1745 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:08.788323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:08.788992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:08.797326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:08.797808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:08.798846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:08.799505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.096421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:09.097305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:09.107386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:09.107900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.108757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:09.109255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.163737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:09.182628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4d83721c-c8ab-4fdd-9159-789fb95deb06 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.398548 Apr 20 18:25:09.183569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 229/471] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:08 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:09.377198 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:09.378352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:09.379103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:09.387379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f53dd793-355e-4681-b5c2-7ac770b9f419 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.294912 Apr 20 18:25:09.388126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:09.388254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 243/472] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:09 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:09.388422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.389255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:09.389743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.512654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:09.513359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:09.521238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:09.521748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.522611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:09.523105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:09.531499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:09.542452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6eb6fe88-c2f4-45fb-b93c-de5873ddb2c8 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1272 microversion: 2.1 time: 0.168928 Apr 20 18:25:09.543324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 230/473] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:09 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:09.736571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:09.746986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:09.748643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:09.749892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a9e0fd06-4f56-4b6d-a402-cdc4fe803589 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1745 microversion: 2.20 time: 0.241649 Apr 20 18:25:09.750532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 244/474] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:09 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:25:10.201835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:10.202420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:10.210755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.211259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.212084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.212572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.405422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:10.406091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:10.414949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.415455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.416392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.416889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.786416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:10.793145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:10.801914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-292ea88d-b994-4bd6-b41c-6844e5d8f6b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.600969 Apr 20 18:25:10.803300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 231/475] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:10 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:10.810039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:10.810744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:10.819944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-537cc4f2-fef8-4684-baa8-cbddb1f08c5e tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.418447 Apr 20 18:25:10.829968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 245/476] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:10 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:10.834087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.834636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.836077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.836579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.836688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:10.837259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:10.853686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.854194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:10.858378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:10.858912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:11.194836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:11.207651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:11.209485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:11.211391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8a26bc2d-dbfb-4e98-8299-964f3958de84 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.381120 Apr 20 18:25:11.211770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 246/477] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:10 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:11.546062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:11.558425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fa939b62-445d-4ceb-920a-baf0b655c842 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.752294 Apr 20 18:25:11.559261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 232/478] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:10 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:11.708041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-c51f27f9-a14a-41cc-a3e6-958d573767f5 req-687315ca-7dfd-4b30-bb1b-ee8c7da32ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d76f42f-0ee4-4faf-a489-4a7496325f01", "tag": "0082900e-375e-431b-8ba8-3a33b09b0577"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:11.710523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:11.710523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:11.722507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c51f27f9-a14a-41cc-a3e6-958d573767f5 req-687315ca-7dfd-4b30-bb1b-ee8c7da32ee6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:11.723291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c51f27f9-a14a-41cc-a3e6-958d573767f5 req-687315ca-7dfd-4b30-bb1b-ee8c7da32ee6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:11.748602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-c51f27f9-a14a-41cc-a3e6-958d573767f5 req-687315ca-7dfd-4b30-bb1b-ee8c7da32ee6 service nova] Creating event network-changed:0082900e-375e-431b-8ba8-3a33b09b0577 for instance 6d76f42f-0ee4-4faf-a489-4a7496325f01 on hv-cinder-78693 Apr 20 18:25:11.754501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-c51f27f9-a14a-41cc-a3e6-958d573767f5 req-687315ca-7dfd-4b30-bb1b-ee8c7da32ee6 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052853 Apr 20 18:25:11.758096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 247/479] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:11.821494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:11.822130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:11.833740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:11.834379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:11.835428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:11.839692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:11.841034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:11.851402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:11.852000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:11.853189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:11.853782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:11.863890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:12.229047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:12.239486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0b4a03e1-9fd6-49a3-b40f-441ad27af595 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.405987 Apr 20 18:25:12.240514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 248/480] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:11 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:12.248330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:12.249146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:12.259820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:12.260590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:12.261744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:12.262409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:12.462637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:12.493895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f7f3d415-3b6f-4f8b-ae4a-fa8e78f90072 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.677005 Apr 20 18:25:12.506646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 233/481] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:11 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:12.576524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:12.577438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:12.584388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:12.591973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:12.593607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:12.597735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:12.598651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:12.599443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:12.603065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:12.604619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f1dc71b-abdc-4597-a025-e74345139843 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.362181 Apr 20 18:25:12.616915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 249/482] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:12 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:12.671645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:12.672188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:12.684998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:12.685502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:12.686352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:12.686883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.094662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lazy-loading 'services' on Instance uuid a2e5ef7b-60f5-4bcb-8f61-f99be17af818 {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:25:13.254869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2299a3a4-0c93-49ae-b7f8-47115f5b89cc tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818/os-volume_attachments/2ac08528-0223-4c25-811a-1fe2c6b9d77f" status: 202 len: 0 microversion: 2.1 time: 0.586836 Apr 20 18:25:13.255536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 250/483] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:25:12 2021] DELETE /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818/os-volume_attachments/2ac08528-0223-4c25-811a-1fe2c6b9d77f => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:25:13.258054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:13.261232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-18c02e4a-ce62-4408-80bb-6bc8e6339b1a req-8b032e94-b340-400d-b545-378aded29330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "name": "network-vif-plugged", "status": "completed", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:13.263118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:13.263118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:13.268758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76e664ab-f7bb-4b03-826a-0199ab6949c4 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.696179 Apr 20 18:25:13.269604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 234/484] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:12 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:13.272394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-18c02e4a-ce62-4408-80bb-6bc8e6339b1a req-8b032e94-b340-400d-b545-378aded29330 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.272899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-18c02e4a-ce62-4408-80bb-6bc8e6339b1a req-8b032e94-b340-400d-b545-378aded29330 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.275670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.276686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:13.288975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.289803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.290904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.291731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.333477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-18c02e4a-ce62-4408-80bb-6bc8e6339b1a req-8b032e94-b340-400d-b545-378aded29330 service nova] Creating event network-vif-plugged:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:25:13.344910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-18c02e4a-ce62-4408-80bb-6bc8e6339b1a req-8b032e94-b340-400d-b545-378aded29330 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084724 Apr 20 18:25:13.345612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 251/485] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:13.515505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.516419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:13.538836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.542519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.543470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.546369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.827102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:13.840328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dfd1a414-a690-471d-9c97-4f7e75f240c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.569125 Apr 20 18:25:13.851882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 235/486] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:13.858069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.859034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:13.868810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.869598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:13.870726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:13.871924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:14.031394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:14.045046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e6ebc2c6-740b-4f0b-895a-3e99e9843d41 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.534629 Apr 20 18:25:14.045929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 252/487] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:14.220699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:14.234017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:14.235718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:14.237529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8ce6cf01-ea11-4194-8e65-a338ec0bec9f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.383708 Apr 20 18:25:14.237529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 236/488] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:14.287268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:14.289776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:14.306220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:14.306854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:14.308288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:14.308865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:14.653095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:14.667660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-41b25ada-a0b2-4c1b-97c7-34be418fa548 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.384552 Apr 20 18:25:14.670421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 253/489] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:14 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:14.859369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:14.860024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:14.870589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:14.871367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:14.872409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:14.873100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.064242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.065133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:15.077476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:15.081600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.082730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:15.085950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.252553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:15.263509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-45be52d4-9e3c-4560-9a61-e2ff2236f602 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.408157 Apr 20 18:25:15.274298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 237/490] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:14 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:15.279773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.280549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:15.289425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:15.289909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.290956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:15.291539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.341137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:15.358295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bb938466-fd39-432e-b940-c454f47794f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.298244 Apr 20 18:25:15.359151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 254/491] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:15.553317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:15.554301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:15.556086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:15.557319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4a6c6fbe-7e35-4144-a970-e56ca014cfa3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.281747 Apr 20 18:25:15.557930 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 238/492] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:15.688410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.689210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:15.698502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:15.699133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.700281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:15.700862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:15.986879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:15.996546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4e0b70e7-9b7c-4e4d-b3fd-02deb12b6540 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.312291 Apr 20 18:25:15.997396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 255/493] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:16.281580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:16.282294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:16.291945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:16.292453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:16.293272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:16.293769 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:16.377191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:16.378141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:16.386953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:16.387728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:16.388764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:16.389443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:16.539536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:16.569022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-48de5b83-74b2-4d36-afcf-e0fae27d4a41 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.291347 Apr 20 18:25:16.574225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 239/494] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:16 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:16.580861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:16.581772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:16.605951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:16.606492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:16.607391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:16.607885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:16.643961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:16.659860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-df9a6de2-4a61-4895-9baf-e8b6aeaeb24b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.286495 Apr 20 18:25:16.660494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 256/495] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:16 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:16.910162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:16.923806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:16.925637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:16.926907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c2324984-49f1-4b14-b46d-f9b050fa3e7c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.350206 Apr 20 18:25:16.927543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 240/496] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:16 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:17.015002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.015653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:17.024253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.025001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.026097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.026741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.266493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.267055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:17.273419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:17.275235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.275747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.276600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.277400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.286403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8f2dec27-d0a9-4f54-b272-87e7be4abda7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.275226 Apr 20 18:25:17.287614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 257/497] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:17.367072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:25:17.561802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-19b8d4d3-2f51-4f73-9445-00181c38cb20 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 204 len: 0 microversion: 2.1 time: 0.298744 Apr 20 18:25:17.566928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 241/498] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:25:17 2021] DELETE /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:25:17.575503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.576181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:17.585772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.587173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.588274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.588971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.597048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.598932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:17.622130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.622693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.624307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.624947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.901229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:17.914300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-49198400-6f3c-432e-9fb7-37e95d37c0e2 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.326240 Apr 20 18:25:17.915377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 242/499] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:17.920205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.920942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:17.932064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.932716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:17.933696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:17.934271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:18.186863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:18.198171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2f636ff2-088c-4eb9-9a58-3729faa905af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.281686 Apr 20 18:25:18.202482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 243/500] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:18.203719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:18.216230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:18.216995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:18.226635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-98a1cec9-13a1-4ed9-b6c9-a652517874e2 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1514 microversion: 2.1 time: 0.645297 Apr 20 18:25:18.227398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 258/501] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1514 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:18.239053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:18.239846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:18.240978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:18.241675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:18.306345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:18.307379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:18.322666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:18.323508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:18.326646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:18.327353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:18.589973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:18.602166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f95f5862-ae4d-4a54-af8d-a7f4c9f3c1f7 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.299819 Apr 20 18:25:18.603085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 259/502] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:18 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:18.763924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:18.779611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:18.781300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:18.798321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-290354e9-3ed4-47b1-ab03-d14715337bb1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.578510 Apr 20 18:25:18.800071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 244/503] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:18 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:18.934611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:18.935361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:18.944618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:18.945475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:18.946417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:18.947032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.178861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:19.188739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6dd90f3b-049c-465d-b455-75224b71c135 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.259308 Apr 20 18:25:19.189354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 260/504] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:18 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:19.217680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:19.218543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:19.227203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.227338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.228113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.228613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.247364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:19.248358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:19.275742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.277973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.284511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.285285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.561958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:19.573708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-236b413e-624d-4cba-b067-e074b852ed36 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1514 microversion: 2.1 time: 0.332323 Apr 20 18:25:19.574796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 261/505] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:19 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1514 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:19.622075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:19.622877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:19.632555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.633166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.634318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.634911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.881171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:19.896002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2b974981-631f-49fd-9aca-7970cb138bb4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.682537 Apr 20 18:25:19.906106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 245/506] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:19 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:19.906106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:19.906106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:19.911894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.912401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.913977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:19.914614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:19.921904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:19.932993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e35599d6-51a9-4f38-b722-d9248bfe851a tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.315168 Apr 20 18:25:19.933828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 262/507] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:19 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:20.211017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:20.211689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:20.228796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:20.229339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:20.231922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:20.236131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:20.241671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:20.251865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:20.253676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:20.255093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-722c8022-e52d-485f-9706-5ba9cd7355ee tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.357426 Apr 20 18:25:20.267332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 246/508] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:19 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:20.591866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:20.595282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:20.621038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:20.624486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:20.625904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:20.631116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.012346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:21.031084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-12f2a558-4267-4b12-a513-40b38e4063b3 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.823919 Apr 20 18:25:21.032064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 263/509] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:20 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:21.048901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:21.051330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:21.068088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.070021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.072232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.074831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.327049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:21.336792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9787682c-90fe-4fca-9638-0bc6c302883a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1514 microversion: 2.1 time: 0.748939 Apr 20 18:25:21.337733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 247/510] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:20 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1514 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:21.343080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:21.344148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:21.353490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.354412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.355467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.356145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.686711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:21.701841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5d1643c3-f879-4fda-9a6f-48e1269bddf3 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.361840 Apr 20 18:25:21.701841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 248/511] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:21 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:21.709209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-786a8dbe-90f2-453f-9958-cd9cc1fcb413 req-d3231d6c-c477-406b-b0eb-23323cbe0b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d76f42f-0ee4-4faf-a489-4a7496325f01", "name": "network-vif-plugged", "status": "completed", "tag": "0082900e-375e-431b-8ba8-3a33b09b0577"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:21.717729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:21.717729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:21.738005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-786a8dbe-90f2-453f-9958-cd9cc1fcb413 req-d3231d6c-c477-406b-b0eb-23323cbe0b82 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.738552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-786a8dbe-90f2-453f-9958-cd9cc1fcb413 req-d3231d6c-c477-406b-b0eb-23323cbe0b82 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.807486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-786a8dbe-90f2-453f-9958-cd9cc1fcb413 req-d3231d6c-c477-406b-b0eb-23323cbe0b82 service nova] Creating event network-vif-plugged:0082900e-375e-431b-8ba8-3a33b09b0577 for instance 6d76f42f-0ee4-4faf-a489-4a7496325f01 on hv-cinder-78693 Apr 20 18:25:21.820966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-786a8dbe-90f2-453f-9958-cd9cc1fcb413 req-d3231d6c-c477-406b-b0eb-23323cbe0b82 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118053 Apr 20 18:25:21.822042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 249/512] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:21.832737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:21.840002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:21.840918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:21.848602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f86560a3-34a4-4432-af01-45405efbce15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.814513 Apr 20 18:25:21.852099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.852614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.853571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.854075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:21.873305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 264/513] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:21 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:21.924052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-b76b23c5-adeb-4344-a17d-51b300be72cb req-9c06e2bd-a720-4bab-9cdb-d8ae265775c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e5ef7b-60f5-4bcb-8f61-f99be17af818", "name": "network-vif-deleted", "tag": "f12fc086-057c-44a7-adb3-c0465ad70c4c"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:21.926032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:21.926032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:21.944106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b76b23c5-adeb-4344-a17d-51b300be72cb req-9c06e2bd-a720-4bab-9cdb-d8ae265775c7 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:21.954831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b76b23c5-adeb-4344-a17d-51b300be72cb req-9c06e2bd-a720-4bab-9cdb-d8ae265775c7 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.009890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-b76b23c5-adeb-4344-a17d-51b300be72cb req-9c06e2bd-a720-4bab-9cdb-d8ae265775c7 service nova] Creating event network-vif-deleted:f12fc086-057c-44a7-adb3-c0465ad70c4c for instance a2e5ef7b-60f5-4bcb-8f61-f99be17af818 on hv-cinder-78693 Apr 20 18:25:22.024567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-b76b23c5-adeb-4344-a17d-51b300be72cb req-9c06e2bd-a720-4bab-9cdb-d8ae265775c7 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104631 Apr 20 18:25:22.025237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 265/514] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:25:22.050280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:22.051085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:22.074109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.074576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.086933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.087536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.310852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:22.322869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:22.331188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:22.332498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0178375b-2808-40fa-b737-19623840f8fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.507618 Apr 20 18:25:22.333108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 250/515] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:21 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:22.356754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:22.357428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:22.371589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.382494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.383428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.383932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.471157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:22.483817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f1868a60-10cb-4c41-8bb4-2595143fbf56 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.438255 Apr 20 18:25:22.484724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 266/516] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:22 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:22.524216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.524819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.525426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lazy-loading 'fault' on Instance uuid a2e5ef7b-60f5-4bcb-8f61-f99be17af818 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:25:22.660204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:22.670000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b61b32c-78d5-4352-8e1a-a9e4742c74ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 200 len: 1307 microversion: 2.1 time: 0.318743 Apr 20 18:25:22.681201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 251/517] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:22 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:22.720021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:22.720687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:22.729759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.730272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.731184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.731685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.883942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:22.892936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:22.903955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.904486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:22.905615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:22.906115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.239629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:23.253155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ff87699-8d85-4327-b784-bd1fdfcd1652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.375838 Apr 20 18:25:23.254653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 252/518] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:22 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:23.314758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:23.337063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d00ac6b5-14d7-4d43-abab-4377df9a0956 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1314 microversion: 2.1 time: 0.620957 Apr 20 18:25:23.338094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 267/519] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:22 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:23.358498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:23.366189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:23.387975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:23.388520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.389393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:23.389897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.504226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:23.505185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:23.515726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:23.516567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.517610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:23.518301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.687714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:23.698955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:23.700904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:23.702252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a783aa24-c685-4f9f-a992-6241e0c772ed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.350537 Apr 20 18:25:23.703217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 253/520] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:23 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:23.716542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:23.717225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: a2e5ef7b-60f5-4bcb-8f61-f99be17af818] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:23.726068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:23.726598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.727461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:23.727963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:23.763523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:23.774024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a20d7487-3ff6-4f1b-bee8-13b34669a8bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.276222 Apr 20 18:25:23.774771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 268/521] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:23 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:23.827892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] HTTP exception thrown: Instance a2e5ef7b-60f5-4bcb-8f61-f99be17af818 could not be found. Apr 20 18:25:23.828694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Returning 404 to user: Instance a2e5ef7b-60f5-4bcb-8f61-f99be17af818 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:23.829922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eee1bcf0-c60f-4127-80e7-010e3fe12689 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818" status: 404 len: 111 microversion: 2.1 time: 0.125460 Apr 20 18:25:23.832258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 254/522] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:23 2021] GET /compute/v2.1/servers/a2e5ef7b-60f5-4bcb-8f61-f99be17af818 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:25:24.273440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.274025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:24.282021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.282569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.290287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.290870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.356582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.357273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:24.366377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.367182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.371324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.374437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.578170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:24.589077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e87288ec-944b-48a7-b20a-a0cda8e40505 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1723 microversion: 2.1 time: 0.320426 Apr 20 18:25:24.589693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 269/523] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:24 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:24.637849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:24.647493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6c6d3a54-5725-4706-9006-1f6fce064137 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1464 microversion: 2.1 time: 0.294522 Apr 20 18:25:24.648103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 255/524] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:24 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1464 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:24.721248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.721912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:24.723057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.723648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:24.729867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.730357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.731190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.731550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.731751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.732065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.732909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.733411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.799131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:25:24.914232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f3d76621-2922-4d5f-ad0b-b1af7ded3a42 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "DELETE /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 204 len: 0 microversion: 2.1 time: 0.195104 Apr 20 18:25:24.915108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 256/525] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:25:24 2021] DELETE /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:25:24.920309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.921104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:24.929283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.929790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.930659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.931154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.949200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:24.958787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:24.960599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:24.961950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-35e98c8e-15d7-4a6d-9e74-13174bd2976c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1740 microversion: 2.20 time: 0.244713 Apr 20 18:25:24.962678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 270/526] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:24 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:24.967376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.968110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:24.975674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.976172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:24.976997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:24.977479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.157074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:25.167409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-21d3d3d8-97a3-42ab-b311-a4641470a4a8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.251294 Apr 20 18:25:25.168738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 257/527] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:24 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:25.172833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:25.173378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:25.182784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.183294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.184139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.184632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.197338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:25.206333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9aa7cfb2-3d93-43cc-9205-8a7b4ce4d0be tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1470 microversion: 2.1 time: 0.242572 Apr 20 18:25:25.207038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 271/528] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:24 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:25.252815 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:25:25.366287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0bb0d0ee-2ed9-487e-83e9-0234cfef98fd tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 204 len: 0 microversion: 2.1 time: 0.196228 Apr 20 18:25:25.367007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 258/529] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:25:25 2021] DELETE /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:25:25.375351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:25.376037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:25.383924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.384439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.385279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.385781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.608347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:25.610763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:25.616724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:25.624099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-aa169024-0687-4201-beab-c2dc4736acf0 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1514 microversion: 2.1 time: 0.252664 Apr 20 18:25:25.624846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 272/530] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:25 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:25.635529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.635529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.635529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.635529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.982587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:25.983259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:25.991905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.992412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:25.993255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:25.993748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.051279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.063397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-be4f86ce-711e-47e4-b9d1-cbf7ea059dcf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1700 microversion: 2.1 time: 0.459399 Apr 20 18:25:26.064313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 259/531] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:25 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1700 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:26.080779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4926a2ef-7c33-483c-80e8-ffdd96249856 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:26.088707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4926a2ef-7c33-483c-80e8-ffdd96249856 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.089207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4926a2ef-7c33-483c-80e8-ffdd96249856 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.153708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4926a2ef-7c33-483c-80e8-ffdd96249856 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Going to try to start instance {{(pid=100570) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 18:25:26.222580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.235383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.237287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.238559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cb6f757d-a56d-4760-9520-5925d7ec8b48 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1722 microversion: 2.20 time: 0.260172 Apr 20 18:25:26.239184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 273/532] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:25 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:25:26.242293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4926a2ef-7c33-483c-80e8-ffdd96249856 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 202 len: 0 microversion: 2.1 time: 0.165034 Apr 20 18:25:26.246038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 260/533] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:25:26 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:25:26.246162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:26.246162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:26.249036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:26.249815 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:26.253332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.254039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.255127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.255793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.259302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.259819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.261343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.262372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.481173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.491015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5bad6933-9c6b-442c-9e2f-351c1c3747dd tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.250703 Apr 20 18:25:26.491683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 274/534] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:26 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:26.496345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:26.496969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:26.504672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.505178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.506010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.506587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.580171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.589906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-be63650e-091d-4e87-b05a-770ac3265562 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1470 microversion: 2.1 time: 0.345121 Apr 20 18:25:26.590659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 261/535] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:26 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:26.643245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:26.643927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:26.652570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.653123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.653971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:26.654486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:26.732523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:26.742989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1bb78404-aedf-4e1a-933c-9d17226a98db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1709 microversion: 2.1 time: 0.250096 Apr 20 18:25:26.743775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 275/536] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:26 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1709 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:27.190218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:27.199772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e0f5b819-a130-443a-a9db-a8864623a9f6 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1514 microversion: 2.1 time: 0.560604 Apr 20 18:25:27.200390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 262/537] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:26 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1514 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:27.259355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:27.260027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:27.268164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.268606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.269447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.269944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.484860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:27.507887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:27.508894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:27.509566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:27.510263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:27.511718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-75d4286b-a086-4dd3-8b57-f7e9dc19f0e7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1722 microversion: 2.20 time: 0.257111 Apr 20 18:25:27.512901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 276/538] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:27 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:27.528137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.528709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.529566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.530112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.609339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:27.610016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:27.618637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.619149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.619976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.620670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.904752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:27.916711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b4e54b84-0018-47f0-9e74-2b09fe87f6d5 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1470 microversion: 2.1 time: 0.311094 Apr 20 18:25:27.917676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 277/539] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:27 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:27.928972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:27.930236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:27.938714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.939230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:27.940090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:27.940590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.257945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:28.268383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7e45bdf4-42fc-4cbf-aaa2-956cd9c773c1 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.763346 Apr 20 18:25:28.269370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 263/540] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:27 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:28.284344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:28.285101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:28.293390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.293886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.294756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.295250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.462171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:28.472384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-98d97694-305c-4970-9ce5-621bbfb76644 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1709 microversion: 2.1 time: 0.548910 Apr 20 18:25:28.473184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 278/541] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:27 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1709 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:28.531898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:28.532734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:28.554359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.555047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.555969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.556530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.872179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:28.885812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cfe211a1-ec27-40a1-9a9f-b73fe7701b68 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1514 microversion: 2.1 time: 0.604589 Apr 20 18:25:28.886571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 264/542] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:28 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1514 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:28.903266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-d2aaa1fb-3e88-481c-877d-f3db221a2835 req-7caee633-1e52-4199-9f31-4a05bcb7f2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d76f42f-0ee4-4faf-a489-4a7496325f01", "name": "network-vif-deleted", "tag": "0082900e-375e-431b-8ba8-3a33b09b0577"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:28.905284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:28.905284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:28.916552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-d2aaa1fb-3e88-481c-877d-f3db221a2835 req-7caee633-1e52-4199-9f31-4a05bcb7f2a4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.917246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-d2aaa1fb-3e88-481c-877d-f3db221a2835 req-7caee633-1e52-4199-9f31-4a05bcb7f2a4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.936944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-d2aaa1fb-3e88-481c-877d-f3db221a2835 req-7caee633-1e52-4199-9f31-4a05bcb7f2a4 service nova] Creating event network-vif-deleted:0082900e-375e-431b-8ba8-3a33b09b0577 for instance 6d76f42f-0ee4-4faf-a489-4a7496325f01 on hv-cinder-78693 Apr 20 18:25:28.942335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-d2aaa1fb-3e88-481c-877d-f3db221a2835 req-7caee633-1e52-4199-9f31-4a05bcb7f2a4 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043576 Apr 20 18:25:28.943171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 265/543] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:28.949743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:28.950768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:28.960571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.961560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:28.962660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:28.963349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.132287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:29.141359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-93b4d86c-307a-4e2d-af1f-6e8730e8f6ee tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1299 microversion: 2.1 time: 0.196048 Apr 20 18:25:29.150786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 266/544] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:28 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:29.150786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-9f0c3286-4a2f-4786-9461-1b072c27c618 req-3adecefc-b82e-400f-94d0-dd87523d6c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "name": "network-vif-unplugged", "status": "completed", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:29.150786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:29.150786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:29.157720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9f0c3286-4a2f-4786-9461-1b072c27c618 req-3adecefc-b82e-400f-94d0-dd87523d6c01 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.158231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9f0c3286-4a2f-4786-9461-1b072c27c618 req-3adecefc-b82e-400f-94d0-dd87523d6c01 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.177301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-9f0c3286-4a2f-4786-9461-1b072c27c618 req-3adecefc-b82e-400f-94d0-dd87523d6c01 service nova] Creating event network-vif-unplugged:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:25:29.182997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-9f0c3286-4a2f-4786-9461-1b072c27c618 req-3adecefc-b82e-400f-94d0-dd87523d6c01 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039725 Apr 20 18:25:29.183809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 267/545] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:29.288609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:29.289496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:29.298036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.298564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.299608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.299994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.318774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:29.329577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:29.331546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:29.333030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-052e19c5-fcb8-4b78-8a84-04a1220cdbc1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1722 microversion: 2.20 time: 0.805675 Apr 20 18:25:29.333859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 279/546] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:28 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1722 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:29.491740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:29.492625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:29.504874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.506801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.510612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.511361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.551715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:29.567711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-73073867-b1b7-401f-8f06-605b27735c71 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.284295 Apr 20 18:25:29.568454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 268/547] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:29 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:29.828432 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-b385d881-3826-47c3-886f-e70b9d487cc0 req-f9169a02-87e3-4c78-b49a-15b9884ee6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f7830e2-cffc-40b0-8ddf-07d5735038b5", "name": "network-vif-deleted", "tag": "5f1fe119-73f4-487d-94c6-c39e1fb10d46"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:29.829558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:29.829558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:29.838624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b385d881-3826-47c3-886f-e70b9d487cc0 req-f9169a02-87e3-4c78-b49a-15b9884ee6dc service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.839133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b385d881-3826-47c3-886f-e70b9d487cc0 req-f9169a02-87e3-4c78-b49a-15b9884ee6dc service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.858862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-b385d881-3826-47c3-886f-e70b9d487cc0 req-f9169a02-87e3-4c78-b49a-15b9884ee6dc service nova] Creating event network-vif-deleted:5f1fe119-73f4-487d-94c6-c39e1fb10d46 for instance 9f7830e2-cffc-40b0-8ddf-07d5735038b5 on hv-cinder-78693 Apr 20 18:25:29.864091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-b385d881-3826-47c3-886f-e70b9d487cc0 req-f9169a02-87e3-4c78-b49a-15b9884ee6dc service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Apr 20 18:25:29.865147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 269/548] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:25:29.919193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:29.920241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:29.929696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.930328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:29.931285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:29.931851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.080809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.090364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-19414e40-d44e-4e59-a066-251719e01399 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 200 len: 1302 microversion: 2.1 time: 0.181985 Apr 20 18:25:30.091192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 270/549] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:29 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 1302 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:30.129732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.142834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f0e4b577-1a2a-46ce-824a-a55c7a6d73ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1713 microversion: 2.1 time: 0.655401 Apr 20 18:25:30.143655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 280/550] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:29 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1713 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:30.160420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:30.161640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:30.171127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.171707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.172657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.173212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.250355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.250902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.251410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lazy-loading 'fault' on Instance uuid 6d76f42f-0ee4-4faf-a489-4a7496325f01 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:25:30.318407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f7aa54e7440119cb9bac3b8c4e2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531ce5185679425eaddb154d9ad70128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.329491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-656d9552-7b31-4c89-9d81-05aefc093808 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 200 len: 1304 microversion: 2.1 time: 0.174037 Apr 20 18:25:30.330224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 271/551] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:30 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:30.353837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:30.354521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:30.362378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.363234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.364083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.364568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.581365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.586724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:30.587383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:30.591904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.593670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.594918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1b9b1752-7161-4814-acff-d8a8951d5bea tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1665 microversion: 2.20 time: 0.245823 Apr 20 18:25:30.595398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.595510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 281/552] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:30 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1665 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:30.595912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.596751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.597248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.613517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f88bc349-6d9d-4efe-a79d-0cf55f1b9763"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:30.614998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:30.622623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.623128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.623956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:30.624444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:30.879008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:30.898926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3631accf-a8c5-4d5e-9005-07c10d4ce729 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.316756 Apr 20 18:25:30.911972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 272/553] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:30 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:31.109112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:31.109794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 9f7830e2-cffc-40b0-8ddf-07d5735038b5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.118218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.118763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.119608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.120107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.160757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bfa508bf-4696-4615-b824-91259b02124a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.551226 Apr 20 18:25:31.161788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 282/554] 10.222.0.22 () {62 vars in 1354 bytes} [Tue Apr 20 18:25:30 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-volume_attachments => generated 188 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:25:31.175241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] HTTP exception thrown: Instance 9f7830e2-cffc-40b0-8ddf-07d5735038b5 could not be found. Apr 20 18:25:31.175922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Returning 404 to user: Instance 9f7830e2-cffc-40b0-8ddf-07d5735038b5 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:31.176837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f2e46ae8-7683-4bc3-9e51-d9fc6a464ab7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5" status: 404 len: 111 microversion: 2.1 time: 0.071929 Apr 20 18:25:31.177454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 273/555] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:31 2021] GET /compute/v2.1/servers/9f7830e2-cffc-40b0-8ddf-07d5735038b5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:25:31.185849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:31.186486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.194938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.195460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.196260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.196747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.260898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Going to try to terminate instance {{(pid=100569) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:25:31.275249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:31.276095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.283881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.284385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.285218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.285760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.381562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1e4e784e-25fd-4737-b59f-7ad7a0af0f69 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 204 len: 0 microversion: 2.1 time: 0.198221 Apr 20 18:25:31.382401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 283/556] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:25:31 2021] DELETE /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:25:31.391351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:31.392126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] [instance: 6d76f42f-0ee4-4faf-a489-4a7496325f01] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.447766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-036def78-dc23-4461-b994-a0737887e20a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action" status: 202 len: 0 microversion: 2.20 time: 0.177280 Apr 20 18:25:31.448435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 274/557] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:25:31 2021] POST /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:25:31.453344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:31.454019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.463195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.463972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.464539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.465032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.549789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.550300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.551193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.551691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.604400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] HTTP exception thrown: Instance 6d76f42f-0ee4-4faf-a489-4a7496325f01 could not be found. Apr 20 18:25:31.605082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] Returning 404 to user: Instance 6d76f42f-0ee4-4faf-a489-4a7496325f01 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:31.606506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f17c2e2-8e14-43ec-91e0-61d8c2a45f72 tempest-VolumesNegativeTest-16525900 tempest-VolumesNegativeTest-16525900-project] 10.222.0.22 "GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01" status: 404 len: 111 microversion: 2.1 time: 0.219265 Apr 20 18:25:31.613696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 284/558] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:31 2021] GET /compute/v2.1/servers/6d76f42f-0ee4-4faf-a489-4a7496325f01 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:25:31.618801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:31.619519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.627360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.627867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.628713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.629213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.690936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:31.701277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7f6e228b-8d8f-4c09-9828-8759373686c7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1514 microversion: 2.1 time: 0.251613 Apr 20 18:25:31.702223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 275/559] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:31 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:31.867124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:31.877920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:31.879926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:31.881820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-adabead3-6fa9-45aa-8429-cb84c2edc987 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1751 microversion: 2.20 time: 0.267266 Apr 20 18:25:31.882718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 285/560] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:31 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1751 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:31.917347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:31.918177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:31.927236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.928370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:31.929486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:31.929927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:32.167106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:32.177170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fe28ef2f-4b17-45be-a8c3-d45de6130ce0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1566 microversion: 2.1 time: 0.264099 Apr 20 18:25:32.177952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 276/561] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:31 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:32.720307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:32.721480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:32.732161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:32.732675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:32.733663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:32.734160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:32.901516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:32.902137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:32.912792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:32.913501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:32.914858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:32.915509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:32.988637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:32.998948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d2c1a4db-4f54-4cf6-98dd-5c5462189288 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1514 microversion: 2.1 time: 0.282832 Apr 20 18:25:32.999883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 286/562] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:32 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:33.143635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:33.154911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:33.156868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:33.158319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bb85c611-edee-498c-b4c9-87369a71cb7e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1753 microversion: 2.20 time: 0.260942 Apr 20 18:25:33.159440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 277/563] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:32 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1753 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:33.194039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:33.194737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:33.205317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:33.205828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:33.206725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:33.207226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:33.639099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:33.656746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c218865-dbbb-4e73-a41b-46904584f0b7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1546 microversion: 2.1 time: 0.464671 Apr 20 18:25:33.657525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 287/564] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:33 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1546 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:33.675004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:33.675783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:33.685354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:33.685949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:33.687168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:33.687860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:33.878054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] HTTP exception thrown: Cannot 'detach_volume' instance 888724ad-feda-4539-a72f-4c20f18b223d while it is in vm_state rescued Apr 20 18:25:33.879307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Returning 409 to user: Cannot 'detach_volume' instance 888724ad-feda-4539-a72f-4c20f18b223d while it is in vm_state rescued {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:33.880220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-25d643e5-25bf-4e8d-9d5a-6b885f60953c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "DELETE /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments/e9fab263-3a61-49ec-8c76-74dc9b2584b7" status: 409 len: 152 microversion: 2.1 time: 0.209446 Apr 20 18:25:33.880814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 278/565] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:25:33 2021] DELETE /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments/e9fab263-3a61-49ec-8c76-74dc9b2584b7 => generated 152 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 18:25:33.889830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:33.890422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:33.898950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:33.899460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:33.900302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:33.900792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.017303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:34.018318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:34.027005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.027810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.028853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.029557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.056629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3980063f-464d-4b94-bc1f-fb29cedad3ac tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action" status: 202 len: 0 microversion: 2.1 time: 0.170422 Apr 20 18:25:34.057496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 288/566] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:25:33 2021] POST /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:25:34.069763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:34.069763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:34.082454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.083175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.084907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.085767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.218949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:34.229033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-34082c7f-3185-474a-8b76-d4d81c2bf2b8 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1472 microversion: 2.1 time: 0.215641 Apr 20 18:25:34.245809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 279/567] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:34 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:34.252587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:34.253492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:34.291566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.292080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.292927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.293415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.807504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:34.833016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:34.835598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:34.837057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-714780b7-64ce-4add-905d-18d5f638a144 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1753 microversion: 2.20 time: 0.589960 Apr 20 18:25:34.837887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 280/568] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:34 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1753 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:34.853336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:34.856586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-84a42e9c-681c-4245-8e7d-c7c00bf2f84d req-f40d8bc3-d183-4703-b907-a448b9d5c4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757b937a-0306-40da-8edb-2ccd83f641cb", "name": "network-vif-deleted", "tag": "d7110f76-a2e0-49fe-8734-f2f940cbb445"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:34.859491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:34.859491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:34.872232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-adf6ed1a-8035-426a-9ae2-3b0d4025588a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.807047 Apr 20 18:25:34.873893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 289/569] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:34 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:34.874441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-84a42e9c-681c-4245-8e7d-c7c00bf2f84d req-f40d8bc3-d183-4703-b907-a448b9d5c4dc service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:34.875041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-84a42e9c-681c-4245-8e7d-c7c00bf2f84d req-f40d8bc3-d183-4703-b907-a448b9d5c4dc service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:34.893758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-84a42e9c-681c-4245-8e7d-c7c00bf2f84d req-f40d8bc3-d183-4703-b907-a448b9d5c4dc service nova] Creating event network-vif-deleted:d7110f76-a2e0-49fe-8734-f2f940cbb445 for instance 757b937a-0306-40da-8edb-2ccd83f641cb on hv-cinder-78693 Apr 20 18:25:34.899842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-84a42e9c-681c-4245-8e7d-c7c00bf2f84d req-f40d8bc3-d183-4703-b907-a448b9d5c4dc service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060287 Apr 20 18:25:34.900797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 281/570] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:35.253970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:35.256685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:35.265914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.266905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:35.268539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.269257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:35.353907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.354692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:35.355350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lazy-loading 'fault' on Instance uuid 757b937a-0306-40da-8edb-2ccd83f641cb {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:25:35.483987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:35.493070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3ad42ebf-2beb-4720-ab26-84452f7dd90d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 200 len: 1308 microversion: 2.1 time: 0.243834 Apr 20 18:25:35.493675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 290/571] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:35 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:35.857919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:35.858711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:35.868016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.868540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:35.869370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.869855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:35.891709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:35.892494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:35.900536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.901064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:35.901858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:35.902348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:36.093719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:36.104504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:36.106185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:36.107491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7aadcce0-178b-44a7-a153-8076998c0297 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.254263 Apr 20 18:25:36.108105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 282/572] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:35 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:36.128168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:36.137640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2cda1389-667e-404d-9420-3fe5bcef9dc0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.249959 Apr 20 18:25:36.138259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 291/573] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:35 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:36.513450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:36.514105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: 757b937a-0306-40da-8edb-2ccd83f641cb] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:36.530059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:36.530775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:36.531808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:36.533908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:36.597292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] HTTP exception thrown: Instance 757b937a-0306-40da-8edb-2ccd83f641cb could not be found. Apr 20 18:25:36.598210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Returning 404 to user: Instance 757b937a-0306-40da-8edb-2ccd83f641cb could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:36.599478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-da6411a0-761a-41b7-9747-18bd7d876f43 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb" status: 404 len: 111 microversion: 2.1 time: 0.090241 Apr 20 18:25:36.600287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 283/574] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:36 2021] GET /compute/v2.1/servers/757b937a-0306-40da-8edb-2ccd83f641cb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:25:37.126899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:37.130772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:37.135654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:37.136157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:37.137002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:37.137488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:37.156673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:37.157508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:37.168100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:37.169112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:37.170278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:37.170793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:37.416826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:37.434275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:37.436968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:37.438947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5ddd82e9-faf0-4104-8db0-d7bf502e3af7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.315999 Apr 20 18:25:37.440100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 292/575] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:37 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:37.445718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:37.456715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dc69ea97-c95a-43f3-a3bd-8e942760e103 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.304118 Apr 20 18:25:37.457686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 284/576] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:37 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:37.940774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:37.941525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:37.950826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:37.951493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:37.952478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:37.953088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.020016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Going to try to terminate instance {{(pid=100569) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:25:38.138119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0b32f737-7b2d-4e1f-ae6a-2c4bd35035fe tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "DELETE /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 204 len: 0 microversion: 2.1 time: 0.203815 Apr 20 18:25:38.138765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 293/577] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:25:37 2021] DELETE /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:25:38.147304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:38.147979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:38.156169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:38.156680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.157529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:38.158025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.377208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:38.386446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-20275031-9bb8-44e8-888b-39b901e469ce tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.243272 Apr 20 18:25:38.387117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 285/578] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:38 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:38.459803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:38.460486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:38.468290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:38.468789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.469614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:38.470112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.477093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:38.477861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:38.486200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:38.486890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.487747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:38.488252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:38.731876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:38.744892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:38.747314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:38.748921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-88cb139e-8e6f-408d-90e6-8b78052596ef tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.294244 Apr 20 18:25:38.750049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 294/579] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:38 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:38.944268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:38.953923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cb420db8-01dd-4f6d-b45b-e745fc3482c7 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.481534 Apr 20 18:25:38.954586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 286/580] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:38 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:39.405410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:39.406077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:39.414316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:39.414856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:39.415691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:39.416179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:39.639576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:39.649192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-06948cca-5f8b-43d7-b87c-a73e0ff3b5e7 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.247744 Apr 20 18:25:39.649832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 295/581] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:39 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:39.769435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:39.770117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:39.778652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:39.779188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:39.780159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:39.780669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:39.975685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:39.976568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:39.984898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:39.985403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:39.986255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:39.986811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:40.011631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:40.024739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:40.028259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:40.029602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c890305c-6483-47b5-b098-defa77f5bb28 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.264383 Apr 20 18:25:40.030572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 287/582] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:39 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:40.211671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:40.221119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eda9380d-b7ab-465c-af0e-003a189e1891 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.252473 Apr 20 18:25:40.221738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 296/583] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:39 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:40.667455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:40.668120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:40.676231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:40.676735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:40.678170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:40.678707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:40.897982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:40.907141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e51e856c-4158-4b4d-b38c-f81a0f2c642d tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.243711 Apr 20 18:25:40.907783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 288/584] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:40 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:41.049918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:41.050621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:41.058767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:41.059270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:41.060124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:41.060622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:41.238867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:41.239540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:41.247748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:41.248257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:41.249107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:41.249603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:41.287249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:41.297597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:41.299523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:41.300793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-31e018ad-cb47-49d4-9bfc-82e52d47a03e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.255160 Apr 20 18:25:41.301584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 297/585] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:41 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:41.478779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:41.488717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-34aff7d9-171c-484c-a6ba-8af207f9fa82 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.253808 Apr 20 18:25:41.489285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 289/586] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:41 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:41.925770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:41.926436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:41.935174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:41.935677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:41.936514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:41.936997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:42.159262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:42.169804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1b3f6fe1-ebb5-4f27-82bb-40012dc7482a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.248310 Apr 20 18:25:42.170647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 298/587] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:41 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:42.321716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:42.322399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:42.330532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:42.331051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:42.331907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:42.332406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:42.507015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:42.507689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:42.515608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:42.516112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:42.516975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:42.517445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:42.556877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:42.566947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:42.569170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:42.570385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f20ffc7-3d29-459e-8b92-b27c54f4946d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.253529 Apr 20 18:25:42.571204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 290/588] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:42 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:42.746145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:42.758831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eab3bf7d-c290-432f-aea3-019de0f08e2a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.255561 Apr 20 18:25:42.760023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 299/589] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:42 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:43.188871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:43.189505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:43.198024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:43.198583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:43.199417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:43.199914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:43.417979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:43.427330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-18613921-55a0-4515-b7e6-1f9b6a36fe55 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.242686 Apr 20 18:25:43.428303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 291/590] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:43 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:43.590949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:43.591610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:43.599618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:43.600118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:43.600953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:43.601436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:43.777380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:43.778370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:43.787409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:43.788228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:43.789292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:43.789990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:43.835843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:43.847057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:43.848647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:43.849924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-de95636e-513c-4ed5-b00d-7ca66dca393f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.263165 Apr 20 18:25:43.850553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 300/591] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:43 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:25:44.022273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:44.031932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bc0cc7e9-c3f3-47b8-a287-43bb60457ff4 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.258481 Apr 20 18:25:44.032737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 292/592] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:43 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:44.446366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:44.447232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:44.455743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:44.456252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:44.457098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:44.457583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:44.674008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:44.683095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-649ae6fb-3d63-4be9-8265-dd43c039f39a tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.241524 Apr 20 18:25:44.683734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 301/593] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:44 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:44.869375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:44.870050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:44.879147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:44.879662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:44.880516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:44.881515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:45.050971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:45.051657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:45.060457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:45.060978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:45.061839 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:45.062391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:45.101573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:45.112105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:45.113782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:45.115585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-70d87a42-9463-4c63-9950-2697b68bc0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.249836 Apr 20 18:25:45.116208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 293/594] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:44 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:45.299083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:45.309390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-45232468-f0db-45c1-bfa6-4bbfe9b1ca39 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.262559 Apr 20 18:25:45.310024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 302/595] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:45 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:45.702323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:45.703004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:45.710973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:45.711475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:45.712302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:45.712790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:45.946479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:45.955691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b8f50761-ff60-44e5-869f-b53be741c323 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.257383 Apr 20 18:25:45.956259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 294/596] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:45 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:46.135190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:46.135906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:46.145127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:46.145309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:46.146153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:46.147214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:46.327901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:46.328699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:46.337518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:46.338129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:46.339104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:46.339698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:46.368862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:46.381421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:46.383451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:46.384926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5307a884-ab56-4b20-82da-218d668f535d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.254102 Apr 20 18:25:46.385769 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 303/597] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:46 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:46.571921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:46.583074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-02aab8d9-2599-4487-a1af-9ed7a6d36ef8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.258936 Apr 20 18:25:46.583798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 295/598] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:46 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:46.974913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:46.975597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:46.983585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:46.984094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:46.984936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:46.985433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:47.205143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:47.213972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a5136d87-4598-4b4a-98ef-cff2ef6c15fb tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.243675 Apr 20 18:25:47.214709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 304/599] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:46 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:47.405316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:47.405942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:47.414823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:47.415341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:47.416182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:47.416685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:47.602041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:47.602877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:47.610868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:47.611384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:47.612232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:47.612732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:47.628225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:47.638194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:47.639882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:47.641095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cf98a85f-39e5-40f7-ae3c-6fd0c194317d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.239948 Apr 20 18:25:47.641699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 296/600] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:47 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:47.827936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:47.838908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4786875a-3bfc-4fd8-bf02-a468cc8d8459 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1554 microversion: 2.1 time: 0.241433 Apr 20 18:25:47.839766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 305/601] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:47 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:48.231966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:48.232634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:48.240593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:48.241113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:48.241944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:48.242443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:48.454348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:48.465250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0de190a9-2da8-41bf-9993-1bb02fa39e1b tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.237305 Apr 20 18:25:48.465995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 297/602] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:48 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:48.661114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:48.662547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:48.670345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:48.670885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:48.671710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:48.672194 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:48.857048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:48.857902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:48.865884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:48.866395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:48.867261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:48.867790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:48.882553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:48.892580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:48.894243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:48.895468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-84d51179-aa8d-429d-a96e-3566cd21846f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.238498 Apr 20 18:25:48.896080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 306/603] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:48 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:49.083121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:49.092512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d66bd60c-85d9-498c-a87f-b85164129e27 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1560 microversion: 2.1 time: 0.239625 Apr 20 18:25:49.093129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 298/604] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:48 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:25:49.210188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:49.210770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:49.218650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:49.219159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:49.219990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:49.220480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:49.392694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lazy-loading 'services' on Instance uuid 888724ad-feda-4539-a72f-4c20f18b223d {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:25:49.484414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:49.485128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:49.493006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:49.493487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:49.494324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:49.494863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:49.532526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ca0dda9b-34b2-4c0d-ae50-234bd3b96315 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "DELETE /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments/e9fab263-3a61-49ec-8c76-74dc9b2584b7" status: 202 len: 0 microversion: 2.1 time: 0.326887 Apr 20 18:25:49.533178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 307/605] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:25:49 2021] DELETE /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d/os-volume_attachments/e9fab263-3a61-49ec-8c76-74dc9b2584b7 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:25:49.713542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:49.722326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbc60337-9673-4b49-a0c0-72d74bd67495 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1513 microversion: 2.1 time: 0.241925 Apr 20 18:25:49.723011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 299/606] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:49 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:49.916886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:49.917591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:49.925859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:49.926369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:49.927231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:49.928242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:50.438252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:50.448786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:50.450469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:50.451709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3b80904e-cf3c-491f-a264-c4c920729146 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.539554 Apr 20 18:25:50.452639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 308/607] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:49 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:50.749360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:50.750032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:50.758685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:50.759295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:50.760806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:50.761356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:50.898434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c2f29521f34fc0bf8356872818be71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3980f2cb8d974b599823aa8a320628ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:50.909410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-87d12989-9c30-419c-aa7e-d4bc0b7adfa1 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 200 len: 1471 microversion: 2.1 time: 0.164204 Apr 20 18:25:50.910816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 300/608] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:50 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:50.917243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-c8c1af38-fd55-4a46-9278-37763140cf6c req-fa7bd4b6-8e84-4933-817e-4bd4fd8fac89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f9d529-91fc-49e7-9140-ed7acdd0b2ed", "name": "network-vif-deleted", "tag": "23191db0-aaaa-416e-8c4b-3abdefac96e7"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:50.919439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:50.919439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:50.930626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c8c1af38-fd55-4a46-9278-37763140cf6c req-fa7bd4b6-8e84-4933-817e-4bd4fd8fac89 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:50.931130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c8c1af38-fd55-4a46-9278-37763140cf6c req-fa7bd4b6-8e84-4933-817e-4bd4fd8fac89 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:50.952475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-c8c1af38-fd55-4a46-9278-37763140cf6c req-fa7bd4b6-8e84-4933-817e-4bd4fd8fac89 service nova] Creating event network-vif-deleted:23191db0-aaaa-416e-8c4b-3abdefac96e7 for instance d1f9d529-91fc-49e7-9140-ed7acdd0b2ed on hv-cinder-78693 Apr 20 18:25:50.959961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-c8c1af38-fd55-4a46-9278-37763140cf6c req-fa7bd4b6-8e84-4933-817e-4bd4fd8fac89 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045310 Apr 20 18:25:50.961126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 309/609] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:51.472462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:51.473232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:51.481747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:51.482265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:51.483136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:51.483639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:51.696899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:51.706968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:51.708656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:51.709880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3fb6509b-c66e-4bca-897a-45afaef8a947 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.242292 Apr 20 18:25:51.710533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 301/610] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:51 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:51.929907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:51.930763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] [instance: d1f9d529-91fc-49e7-9140-ed7acdd0b2ed] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:51.938927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:51.939437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:51.940273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:51.940768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:51.993709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] HTTP exception thrown: Instance d1f9d529-91fc-49e7-9140-ed7acdd0b2ed could not be found. Apr 20 18:25:51.994392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] Returning 404 to user: Instance d1f9d529-91fc-49e7-9140-ed7acdd0b2ed could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:51.995323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ca93d9c2-eb5d-4a7d-90d5-25bd7d7c3fe4 tempest-AttachVolumeNegativeTest-1120407012 tempest-AttachVolumeNegativeTest-1120407012-project] 10.222.0.22 "GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed" status: 404 len: 111 microversion: 2.1 time: 0.070500 Apr 20 18:25:51.995931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 310/611] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:51 2021] GET /compute/v2.1/servers/d1f9d529-91fc-49e7-9140-ed7acdd0b2ed => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:25:52.730487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:52.731155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:52.739706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:52.740218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:52.741079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:52.741575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:52.969429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:52.979585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:52.981294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:52.982520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-89b92bea-9e30-4c6f-b41a-0844ef95b117 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.256335 Apr 20 18:25:52.983130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 302/612] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:52 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:54.001623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:54.002295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:54.010483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:54.010998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:54.011855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:54.012355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:54.229309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:54.239440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:54.241632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:54.242926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-340a1f9a-602b-40b3-bcdf-75fb5548f4d2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.245518 Apr 20 18:25:54.243538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 311/613] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:53 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:54.460390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:54.460944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:54.468711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:54.469223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:54.470055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:54.470603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:54.537339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:25:54.664670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b4acdf6-6381-4c4a-91b7-101ed7ee5493 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "DELETE /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 204 len: 0 microversion: 2.1 time: 0.208137 Apr 20 18:25:54.665356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 303/614] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:25:54 2021] DELETE /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:25:54.674300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:54.675103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:54.683641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:54.684152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:54.684993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:54.685486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:54.903714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:54.913440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d2fe7282-fdd1-4d9f-960c-5bbe5824ebd8 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1507 microversion: 2.1 time: 0.243384 Apr 20 18:25:54.914066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 312/615] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:54 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:55.263074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:55.263849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:55.271740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:55.272248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:55.273084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:55.273641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:55.492110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:55.502108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:55.503832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:55.505049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-549a4db8-72d9-406c-a81d-d4075fa51e97 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.246560 Apr 20 18:25:55.505657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 304/616] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:55 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:55.931626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:55.932293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:55.940201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:55.940735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:55.941555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:55.942037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:56.161008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:56.170554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-47604faa-1ad4-4a8d-a357-2dec2405f98c tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1507 microversion: 2.1 time: 0.242785 Apr 20 18:25:56.171444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 313/617] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:55 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:56.524625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:56.525224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:56.533169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:56.533672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:56.534764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:56.535360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:56.745018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:56.755114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:56.756838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:56.758070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1c1b0ee0-dac2-4a56-8cc1-610b04118f2e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.237725 Apr 20 18:25:56.759056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 305/618] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:56 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:57.188238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:57.188898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:57.197393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:57.197888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:57.198739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:57.199223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:57.613473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:57.623780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-79a50b4e-e2ed-44c7-934a-5acb7468f02a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1507 microversion: 2.1 time: 0.439462 Apr 20 18:25:57.624432 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 314/619] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:57 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:57.777405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:57.778342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:57.786699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:57.787963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:57.788985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:57.789667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:58.011322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:58.021952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:58.023649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:58.024868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c4cfbb34-3e8d-4581-ba54-a0e1ed0efa65 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.251467 Apr 20 18:25:58.025487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 306/620] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:57 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:58.199665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-f8e47609-cb8f-4f85-9a35-2de01178c35b req-bdeee47c-ef70-490c-b936-22b92cf6d5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2", "name": "network-vif-deleted", "tag": "d239680d-38c9-4ba3-bd52-11d907a6c4ab"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:58.201436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:25:58.201436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:25:58.210397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-f8e47609-cb8f-4f85-9a35-2de01178c35b req-bdeee47c-ef70-490c-b936-22b92cf6d5cd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:58.210926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-f8e47609-cb8f-4f85-9a35-2de01178c35b req-bdeee47c-ef70-490c-b936-22b92cf6d5cd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:58.228858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-f8e47609-cb8f-4f85-9a35-2de01178c35b req-bdeee47c-ef70-490c-b936-22b92cf6d5cd service nova] Creating event network-vif-deleted:d239680d-38c9-4ba3-bd52-11d907a6c4ab for instance 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 on hv-cinder-78693 Apr 20 18:25:58.233728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-f8e47609-cb8f-4f85-9a35-2de01178c35b req-bdeee47c-ef70-490c-b936-22b92cf6d5cd service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038118 Apr 20 18:25:58.234350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 315/621] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:58.641258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:58.641952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:58.649892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:58.650394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:58.651251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:58.651738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:58.912168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:58.920847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-92074d6f-46fe-4db2-96da-44375b36381a tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1465 microversion: 2.1 time: 0.283588 Apr 20 18:25:58.921454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 307/622] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:58 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1465 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:59.045259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:59.046014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:59.054813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:59.055321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:59.056146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:59.056634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:59.269989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:59.279833 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:59.281492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:25:59.282739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2cb70514-6833-4a16-b52b-0cb2e46222e4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.242059 Apr 20 18:25:59.283531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 316/623] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:25:59 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:59.938572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:59.939171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:25:59.947506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:59.948008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:25:59.948826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:25:59.949314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:00.074281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:00.083113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-42b9da57-f945-421f-bca6-0cf6f30cd756 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1293 microversion: 2.1 time: 0.148673 Apr 20 18:26:00.083726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 308/624] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:25:59 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:00.302843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:00.303511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:00.311455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:00.311961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:00.312797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:00.313289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:00.522990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:00.532968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:00.534722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:00.535946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f6a67227-6f9a-4f1f-9fdc-c61e31bcc007 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.237166 Apr 20 18:26:00.536809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 317/625] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:00 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:01.099880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:01.100550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:01.108231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:01.108734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:01.109682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:01.110170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:01.189575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:01.190071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:01.190602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lazy-loading 'fault' on Instance uuid 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:26:01.253638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:01.262391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fba90c77-82b4-4c6c-9e06-cdf447ea83fe tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 200 len: 1312 microversion: 2.1 time: 0.166608 Apr 20 18:26:01.263052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 309/626] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:01 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:01.556243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:01.556921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:01.564758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:01.565263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:01.566091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:01.566609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:01.779563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:01.790374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:01.792061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:01.793284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4336aa1f-2bf0-4475-b767-acadaba7c970 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.241625 Apr 20 18:26:01.794083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 318/627] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:01 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:02.281232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:02.282076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:02.290166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.290796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.291708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.292304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.347648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] HTTP exception thrown: Instance 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 could not be found. Apr 20 18:26:02.348325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Returning 404 to user: Instance 6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:26:02.349250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bd006a1e-e19b-4138-9b47-109b5cb4e0eb tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2" status: 404 len: 111 microversion: 2.1 time: 0.072025 Apr 20 18:26:02.349853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 310/628] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:02 2021] GET /compute/v2.1/servers/6688fe1d-5b0e-4d5f-aff8-1cb4589aa6a2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:26:02.358667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:02.359249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:02.372092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.372538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.373387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.373880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.443807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Going to try to terminate instance {{(pid=100569) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:26:02.559243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ebb5a4ca-c6f3-462f-8af4-29cf31f397bc tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "DELETE /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 204 len: 0 microversion: 2.1 time: 0.204516 Apr 20 18:26:02.560052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 319/629] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:26:02 2021] DELETE /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:26:02.569227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:02.569893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:02.577796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.578297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.579198 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.579688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.795171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:02.804688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d74a3c1b-86d1-41cb-9b76-55f954a1aa66 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.240079 Apr 20 18:26:02.805502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 311/630] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:02 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:02.813773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:02.814568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:02.827363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.827874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.828727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.829213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.849518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-cf361b51-fa29-424e-8df6-c7a7c1dc4564 req-a00b2023-002a-4e22-8dad-e805138d3c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "name": "network-vif-plugged", "status": "completed", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:26:02.851949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:26:02.851949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:26:02.860965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-cf361b51-fa29-424e-8df6-c7a7c1dc4564 req-a00b2023-002a-4e22-8dad-e805138d3c69 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:02.861464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-cf361b51-fa29-424e-8df6-c7a7c1dc4564 req-a00b2023-002a-4e22-8dad-e805138d3c69 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:02.879318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-cf361b51-fa29-424e-8df6-c7a7c1dc4564 req-a00b2023-002a-4e22-8dad-e805138d3c69 service nova] Creating event network-vif-plugged:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:26:02.884617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-cf361b51-fa29-424e-8df6-c7a7c1dc4564 req-a00b2023-002a-4e22-8dad-e805138d3c69 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041190 Apr 20 18:26:02.885425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 312/631] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:26:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:26:03.044311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:03.055191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:03.057016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:03.058232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-69aea323-d22f-4b3c-8801-c3fd1ac233f9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.249029 Apr 20 18:26:03.058882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 320/632] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:02 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:03.823862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:03.824702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:03.833027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:03.834045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:03.834907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:03.835442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:04.050279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:04.059176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-71bdff11-9588-4f07-8bcf-c2e902652d9d tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.239932 Apr 20 18:26:04.059735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 313/633] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:03 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:04.077413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:04.078158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:04.086514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:04.087016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:04.087843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:04.088330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:04.301625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:04.311584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:04.313193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:04.314388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6e2c339a-47d1-48b2-a808-eda7a5b30880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.241119 Apr 20 18:26:04.315048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 321/634] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:04 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:05.081216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:05.082542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:05.090917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:05.091410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:05.092415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:05.092911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:05.310818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:05.322152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8bf7bbbd-c938-4899-b8ec-738d22e98b21 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.248369 Apr 20 18:26:05.322813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 314/635] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:05 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:05.334035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:05.334723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:05.347377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:05.347888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:05.348693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:05.349806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:05.578696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:05.589244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:05.590926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:05.592211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76c9e9a5-bc71-4c15-b170-aab28a50f412 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1809 microversion: 2.20 time: 0.262722 Apr 20 18:26:05.600931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 322/636] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:05 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:06.340476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:06.341151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:06.350066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:06.350958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:06.351849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:06.352347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:06.570838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:06.579848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-45806175-ca4c-49f0-9969-f3cd76829ef5 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.243497 Apr 20 18:26:06.580457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 315/637] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:06 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:06.612042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:06.612709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:06.620583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:06.621093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:06.621903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:06.622486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:06.847468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:06.857744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:06.859486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:06.860717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-716a670f-6041-4bcc-8ca2-57b4655b48c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1796 microversion: 2.20 time: 0.252871 Apr 20 18:26:06.861397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 323/638] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:06 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1796 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:07.598105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:07.598737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:07.606694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:07.607208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:07.608047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:07.608587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:07.666395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:26:07.670703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:26:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d (ip 10.222.0.22) !!! Apr 20 18:26:07.846806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:07.856342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-700c833a-aba3-4b95-9eb1-bac0edd546c0 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.262397 Apr 20 18:26:07.856963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 316/639] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:07 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:08.875021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:08.875686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:08.883534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:08.884039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:08.885171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:08.885660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:09.114044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:09.123616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ae29ac12-b982-4cb3-85e8-5ba9937de667 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1520 microversion: 2.1 time: 0.252872 Apr 20 18:26:09.124245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 324/640] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:08 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:09.881086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:09.882234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:09.891698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:09.892215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:09.893061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:09.893557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:10.068323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lazy-loading 'services' on Instance uuid 291eea25-3def-4661-bf74-4a540fedde0a {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:26:10.141444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:10.142199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:10.150807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:10.151407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:10.152327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:10.152893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:10.221970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6bd84788-4993-45a8-bd2e-fb24a8ecbdc2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/os-volume_attachments/f2d2ce98-a83c-41a2-9527-e16930250eb6" status: 202 len: 0 microversion: 2.1 time: 0.345193 Apr 20 18:26:10.222917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 317/641] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:26:09 2021] DELETE /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/os-volume_attachments/f2d2ce98-a83c-41a2-9527-e16930250eb6 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:26:10.228831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-7f6e4ea6-3947-449c-8f05-a8ec53daa762 req-3f0c6faf-e99d-4db2-9482-b03dd0d284f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888724ad-feda-4539-a72f-4c20f18b223d", "name": "network-vif-deleted", "tag": "f4183893-034f-4afd-ada7-b34dd9be918e"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:26:10.230961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:26:10.230961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:26:10.241423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-7f6e4ea6-3947-449c-8f05-a8ec53daa762 req-3f0c6faf-e99d-4db2-9482-b03dd0d284f5 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:10.242208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-7f6e4ea6-3947-449c-8f05-a8ec53daa762 req-3f0c6faf-e99d-4db2-9482-b03dd0d284f5 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:10.261045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-7f6e4ea6-3947-449c-8f05-a8ec53daa762 req-3f0c6faf-e99d-4db2-9482-b03dd0d284f5 service nova] Creating event network-vif-deleted:f4183893-034f-4afd-ada7-b34dd9be918e for instance 888724ad-feda-4539-a72f-4c20f18b223d on hv-cinder-78693 Apr 20 18:26:10.267456 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-7f6e4ea6-3947-449c-8f05-a8ec53daa762 req-3f0c6faf-e99d-4db2-9482-b03dd0d284f5 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042821 Apr 20 18:26:10.268627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 318/642] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:26:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:26:10.325347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e075ca5d3ffd456299f20129025c517c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955c260aa1614be9af3114cf4e8f268a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:10.335376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0a052a06-550a-4e1a-978b-a7ceed5d30ad tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 200 len: 1478 microversion: 2.1 time: 0.198129 Apr 20 18:26:10.335988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 325/643] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:10 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 1478 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:11.358284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:11.359658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] [instance: 888724ad-feda-4539-a72f-4c20f18b223d] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:11.368774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:11.369500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:11.370587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:11.371299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:11.428487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] HTTP exception thrown: Instance 888724ad-feda-4539-a72f-4c20f18b223d could not be found. Apr 20 18:26:11.429186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] Returning 404 to user: Instance 888724ad-feda-4539-a72f-4c20f18b223d could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:26:11.430244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-812720b5-c88f-4ffe-9173-26e684669e05 tempest-ServerRescueNegativeTestJSON-9834487 tempest-ServerRescueNegativeTestJSON-9834487-project] 10.222.0.22 "GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d" status: 404 len: 111 microversion: 2.1 time: 0.080301 Apr 20 18:26:11.430888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 319/644] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:11 2021] GET /compute/v2.1/servers/888724ad-feda-4539-a72f-4c20f18b223d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:26:11.447444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6d88ad51-453c-4289-8d36-f85d1ce678b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:26:11.455817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d88ad51-453c-4289-8d36-f85d1ce678b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:11.456325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d88ad51-453c-4289-8d36-f85d1ce678b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:11.516151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6d88ad51-453c-4289-8d36-f85d1ce678b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Going to try to stop instance {{(pid=100569) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 18:26:11.596620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6d88ad51-453c-4289-8d36-f85d1ce678b5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 202 len: 0 microversion: 2.1 time: 0.152971 Apr 20 18:26:11.597360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 326/645] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:26:11 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:26:11.606536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:11.607528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:11.615615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:11.616441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:11.617385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:11.618084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:11.873436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:11.884242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5a651a2d-a74c-4398-aff8-4dcb6ba153ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1677 microversion: 2.1 time: 0.281769 Apr 20 18:26:11.885212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 320/646] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:11 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:12.642564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:26:12.643074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:26:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:26:12.904989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:12.905758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:12.914082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:12.914613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:12.915447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:12.915936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:13.418012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:13.428149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b7f6c237-ff3b-4b7f-a5d1-7af5b9b33b37 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1677 microversion: 2.1 time: 0.527676 Apr 20 18:26:13.429048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 327/647] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:12 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1677 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:14.448342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:14.450077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:14.458866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:14.460121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:14.461122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:14.461823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:14.878383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:14.888789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6f3be7c4-59af-42f4-837d-95809528d1ab tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1677 microversion: 2.1 time: 0.445466 Apr 20 18:26:14.889653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 321/648] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:14 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1677 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:15.907783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:15.908461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:15.917683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:15.918189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:15.919074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:15.919567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:16.149657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:16.159818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f2fcd88-de5f-41ce-9d10-20e719f39d68 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1677 microversion: 2.1 time: 0.256139 Apr 20 18:26:16.160499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 328/649] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:15 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:17.178920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:17.179598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:17.190433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:17.190969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:17.191820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:17.192846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:17.409961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:17.419183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fce273c9-8f46-498c-a7b8-f425762da0af tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1654 microversion: 2.1 time: 0.244467 Apr 20 18:26:17.419817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 322/650] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:17 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1654 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:17.437112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ccd51150-7005-4805-b395-ca82961b91be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:26:17.445592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ccd51150-7005-4805-b395-ca82961b91be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:17.446102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ccd51150-7005-4805-b395-ca82961b91be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:17.513321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ccd51150-7005-4805-b395-ca82961b91be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Going to try to start instance {{(pid=100569) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 18:26:17.597846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ccd51150-7005-4805-b395-ca82961b91be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action" status: 202 len: 0 microversion: 2.1 time: 0.164469 Apr 20 18:26:17.598469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 329/651] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:26:17 2021] POST /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:26:17.615731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:17.616408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:17.624818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:17.625332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:17.626176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:17.626724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:17.890047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:17.899826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d9c66d15-744d-413f-85ef-0f212c1429a2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1663 microversion: 2.1 time: 0.288142 Apr 20 18:26:17.900436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 323/652] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:17 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1663 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:18.919638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:18.920403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:18.934919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:18.935440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:18.936298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:18.936835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:19.158779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:19.168678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7bf7b48c-7b3b-490b-bfcc-dce268b76769 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1663 microversion: 2.1 time: 0.253571 Apr 20 18:26:19.169305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 330/653] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:18 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1663 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:20.187292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:20.187918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:20.195858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:20.196378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:20.197219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:20.197716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:20.423398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:20.433072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bb952e36-176e-40a6-a732-92f4bd78b164 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1667 microversion: 2.1 time: 0.249700 Apr 20 18:26:20.433687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 324/654] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:26:20 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1667 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:26:55.107936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:55.108478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:55.116898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:55.117417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:55.118241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:55.118811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:55.190528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d478acb3-ec6b-447b-bd70-60bd2681bb3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-volume_attachments/f88bc349-6d9d-4efe-a79d-0cf55f1b9763" status: 200 len: 194 microversion: 2.20 time: 0.086913 Apr 20 18:26:55.193533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 331/655] 10.222.0.22 () {60 vars in 1444 bytes} [Tue Apr 20 18:26:55 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-volume_attachments/f88bc349-6d9d-4efe-a79d-0cf55f1b9763 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:26:55.304560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:55.305101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:55.313019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:55.313521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:55.314347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:55.314888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:55.487031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lazy-loading 'services' on Instance uuid 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:26:55.629991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bac27fb1-0060-4262-b1f1-16c4ba8052d6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-volume_attachments/f88bc349-6d9d-4efe-a79d-0cf55f1b9763" status: 202 len: 0 microversion: 2.20 time: 0.330030 Apr 20 18:26:55.630674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 325/656] 10.222.0.22 () {60 vars in 1447 bytes} [Tue Apr 20 18:26:55 2021] DELETE /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27/os-volume_attachments/f88bc349-6d9d-4efe-a79d-0cf55f1b9763 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:26:56.866170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:56.866909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:56.874960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:56.875625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:56.876460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:56.876947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:56.944487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Going to try to terminate instance {{(pid=100569) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:26:57.065610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-89894866-39f9-4550-a794-988916bcb0c2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 204 len: 0 microversion: 2.20 time: 0.203630 Apr 20 18:26:57.066387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 332/657] 10.222.0.22 () {60 vars in 1270 bytes} [Tue Apr 20 18:26:56 2021] DELETE /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:26:57.076223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:57.077233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:57.086078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:57.086759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:57.087622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:57.088118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:57.397583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:57.407616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:57.409323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:57.410593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eb50dc0d-31d1-4cc3-883d-032f177c95b6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.339007 Apr 20 18:26:57.411196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 326/658] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:57 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:58.432592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:58.434919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:58.442786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:58.443222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:58.444920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:58.445431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:58.685693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:58.698942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:58.701444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:26:58.702721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-79fe8f68-ef67-492e-983e-a94c14dda893 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.274657 Apr 20 18:26:58.703486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 333/659] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:58 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:59.722933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:59.724320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:26:59.733087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:59.733940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:26:59.734978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:26:59.735646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:00.018954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:00.029278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:00.031030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:00.032268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ac766ba7-512d-42db-8b33-b043cc37a7a9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1724 microversion: 2.20 time: 0.313842 Apr 20 18:27:00.033101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 327/660] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:26:59 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:00.565795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-8e15d5f7-06f5-4339-af7d-a67f6054d115 req-64771911-4268-4603-af48-48df4113d0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27", "name": "network-vif-deleted", "tag": "b2a0881e-aa0d-4b50-9adb-fff6187fd91a"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:00.568351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:00.568351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:00.579574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-8e15d5f7-06f5-4339-af7d-a67f6054d115 req-64771911-4268-4603-af48-48df4113d0a3 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:00.580301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-8e15d5f7-06f5-4339-af7d-a67f6054d115 req-64771911-4268-4603-af48-48df4113d0a3 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:00.611452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-8e15d5f7-06f5-4339-af7d-a67f6054d115 req-64771911-4268-4603-af48-48df4113d0a3 service nova] Creating event network-vif-deleted:b2a0881e-aa0d-4b50-9adb-fff6187fd91a for instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 on hv-cinder-78693 Apr 20 18:27:00.617414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-8e15d5f7-06f5-4339-af7d-a67f6054d115 req-64771911-4268-4603-af48-48df4113d0a3 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056624 Apr 20 18:27:00.618086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 334/661] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:01.054987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:01.055569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:01.069984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:01.071390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:01.072852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:01.073699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:01.171019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:01.186414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:01.186414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lazy-loading 'fault' on Instance uuid 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:27:01.245300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:01.256568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:01.258772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:01.259852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-805dc904-df9d-4e03-8142-07ec1505b2fd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 200 len: 1372 microversion: 2.20 time: 0.209833 Apr 20 18:27:01.260459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 328/662] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:01 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:02.280973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:02.282592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:02.301275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:02.301967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:02.303338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:02.304131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:02.376226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] HTTP exception thrown: Instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 could not be found. Apr 20 18:27:02.377294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Returning 404 to user: Instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:27:02.378589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-091cb036-79ec-43c3-a517-f4502c435c3b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 404 len: 111 microversion: 2.20 time: 0.102872 Apr 20 18:27:02.383177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 335/663] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:02 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:27:02.394442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-48b5792b-9162-44eb-a22f-602f520f38b4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '.version_select at 0x7f1a1c8530d0>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:02.417595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-48b5792b-9162-44eb-a22f-602f520f38b4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116938402" status: 204 len: 0 microversion: 2.20 time: 0.033231 Apr 20 18:27:02.418548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 329/664] 10.222.0.22 () {60 vars in 1252 bytes} [Tue Apr 20 18:27:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116938402 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:27:03.742813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-69bfa28c-c248-4ca5-8149-0aac21c91a13 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'create', calling method: .version_select at 0x7f1a1749c840>, body: {"keypair": {"name": "tempest-keypair-410904299"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:03.767987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-69bfa28c-c248-4ca5-8149-0aac21c91a13 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:03.772845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-69bfa28c-c248-4ca5-8149-0aac21c91a13 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for user 24529cdaf02244a78d926691d0342d01 and project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:03.940470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-69bfa28c-c248-4ca5-8149-0aac21c91a13 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:03.945235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-69bfa28c-c248-4ca5-8149-0aac21c91a13 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for user 24529cdaf02244a78d926691d0342d01 and project ef76467afabe40069eec102250c40fc0. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:03.958657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-69bfa28c-c248-4ca5-8149-0aac21c91a13 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.222166 Apr 20 18:27:03.959535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 336/665] 10.222.0.22 () {62 vars in 1189 bytes} [Tue Apr 20 18:27:03 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 20 18:27:06.288414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1084785824", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a442676-e97d-483e-b6c5-5a6a805f152b"}], "security_groups": [{"name": "tempest-securitygroup--1891338733"}], "key_name": "tempest-keypair-410904299", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:06.490127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] validate_networks() for [('0a442676-e97d-483e-b6c5-5a6a805f152b', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:27:06.580438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:06.580989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:06.592994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:06.593396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:06.594245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:06.594764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:06.658928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Going to try to terminate instance {{(pid=100569) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:27:06.783691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2ed91c60-663d-454f-980b-b18179205310 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 204 len: 0 microversion: 2.1 time: 0.206921 Apr 20 18:27:06.784727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 337/666] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:27:06 2021] DELETE /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:27:06.793618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:06.794393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:06.802279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:06.802842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:06.804193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:06.804683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:07.027078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:07.045801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b50d71ad-d097-4fe8-8eb5-f284d9b87ed0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1673 microversion: 2.1 time: 0.256424 Apr 20 18:27:07.046442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 338/667] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:06 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:07.395410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:27:07.396677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:27:07.397724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:27:07.398539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:27:07.399169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:27:07.409928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:07.411030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:07.412060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:07.413547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:07.436779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for project ef76467afabe40069eec102250c40fc0. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:07.442551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Getting quotas for user 24529cdaf02244a78d926691d0342d01 and project ef76467afabe40069eec102250c40fc0. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:07.457336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:27:07.467548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:27:07.533785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-55d5a0a6-5d43-437c-9f16-4c74f9c728f6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.250641 Apr 20 18:27:07.534593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 330/668] 10.222.0.22 () {62 vars in 1178 bytes} [Tue Apr 20 18:27:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 18:27:07.546044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c29aaba5-e62a-470a-a29c-cfe535f3618a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:07.546753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c29aaba5-e62a-470a-a29c-cfe535f3618a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:07.733073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c29aaba5-e62a-470a-a29c-cfe535f3618a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:07.743431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c29aaba5-e62a-470a-a29c-cfe535f3618a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:07.745944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c29aaba5-e62a-470a-a29c-cfe535f3618a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:07.747811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c29aaba5-e62a-470a-a29c-cfe535f3618a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1281 microversion: 2.20 time: 0.205705 Apr 20 18:27:07.748778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 339/669] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:07 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:08.064777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:08.066651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:08.077157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:08.077682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:08.078584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:08.079231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:08.425620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:08.432806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5ddccb56-b3a2-4ad8-b820-2e15fd36e418 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1673 microversion: 2.1 time: 0.372613 Apr 20 18:27:08.440499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 331/670] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:08 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1673 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:08.767418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:08.768089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:08.780488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:08.781464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:08.782572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:08.783393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:08.966819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:08.980123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:08.982703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:08.984149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-47dcc1f6-3623-43ed-819a-271810ac0348 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1333 microversion: 2.20 time: 0.220845 Apr 20 18:27:08.984976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 340/671] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:08 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1333 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:09.409680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1108582428", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "febb036d-f1e0-45d4-9851-73996168e7b8"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:09.452369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:09.453529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:09.466140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:09.466992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:09.467996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:09.468780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:09.493120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] validate_networks() for [('febb036d-f1e0-45d4-9851-73996168e7b8', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:27:09.949123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:09.965026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8fab0bc3-b401-4cf6-a2c3-7cc167073ae2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1673 microversion: 2.1 time: 0.518029 Apr 20 18:27:09.965917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 341/672] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:09 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1673 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:10.004697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:10.005379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:10.013905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:10.014417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:10.015390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:10.016030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:10.159163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:10.169475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:10.171340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:10.172601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-37009e31-5bac-40c8-ac67-8b89317d56ac tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1339 microversion: 2.20 time: 0.172195 Apr 20 18:27:10.173386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 342/673] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:09 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:27:10.626154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:27:10.627113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:27:10.627913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:27:10.628515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:27:10.629133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:27:10.646243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:10.647670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:10.653945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:10.655103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:10.688127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Getting quotas for project 1075f749f50d4350a332442d30431fe7. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:10.694872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Getting quotas for user 1a457d841519493cbd55b66075d311e7 and project 1075f749f50d4350a332442d30431fe7. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:10.721890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:27:10.728029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:27:10.860241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dc81c719-c335-42f4-bd07-2b3766b9b2b9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454579 Apr 20 18:27:10.860960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 332/674] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:27:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:27:10.873509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-aa8edb7b-6455-4bdd-9aed-5793de265344 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:10.874748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-aa8edb7b-6455-4bdd-9aed-5793de265344 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:10.883655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-c1f9026b-3d30-4f20-afb7-54b3e82a6cb4 req-5914853f-ed15-4b8a-8633-471f444d2e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291eea25-3def-4661-bf74-4a540fedde0a", "name": "network-vif-deleted", "tag": "0687950b-e993-4a24-910e-500f131bfe37"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:10.885935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:10.885935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:10.908898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c1f9026b-3d30-4f20-afb7-54b3e82a6cb4 req-5914853f-ed15-4b8a-8633-471f444d2e37 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:10.909405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-c1f9026b-3d30-4f20-afb7-54b3e82a6cb4 req-5914853f-ed15-4b8a-8633-471f444d2e37 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:10.963126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-c1f9026b-3d30-4f20-afb7-54b3e82a6cb4 req-5914853f-ed15-4b8a-8633-471f444d2e37 service nova] Creating event network-vif-deleted:0687950b-e993-4a24-910e-500f131bfe37 for instance 291eea25-3def-4661-bf74-4a540fedde0a on hv-cinder-78693 Apr 20 18:27:10.979796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-c1f9026b-3d30-4f20-afb7-54b3e82a6cb4 req-5914853f-ed15-4b8a-8633-471f444d2e37 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096098 Apr 20 18:27:10.980821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 333/675] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:10.986596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:10.986763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-aa8edb7b-6455-4bdd-9aed-5793de265344 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:10.987334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:11.001520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-aa8edb7b-6455-4bdd-9aed-5793de265344 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1219 microversion: 2.1 time: 0.132579 Apr 20 18:27:11.002504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 343/676] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:10 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:11.017038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:11.017560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:11.018423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:11.019613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:11.151651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:11.152166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:11.152684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lazy-loading 'fault' on Instance uuid 291eea25-3def-4661-bf74-4a540fedde0a {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:27:11.193483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:11.194934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:11.214952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:11.216543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:11.217865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:11.218602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:11.242577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:11.263986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-18705cf1-748e-4523-bf63-f42bc7dceb34 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 200 len: 1328 microversion: 2.1 time: 0.281616 Apr 20 18:27:11.264914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 334/677] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:10 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 1328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:11.546066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:11.558123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:11.560005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:11.561289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0a2d6d04-27c1-46a8-90b2-fa6ea45440fc tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.372488 Apr 20 18:27:11.562220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 344/678] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:11 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:12.022239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:12.022916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:12.038023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.041432 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.042349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.043707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.284393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:12.285062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:12.296581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:12.302345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.303453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.304319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.304788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.313202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-86adff4a-8401-4714-93c5-6a6550c2b945 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1271 microversion: 2.1 time: 0.296133 Apr 20 18:27:12.323549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 335/679] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:12 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:12.430422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] HTTP exception thrown: Instance 291eea25-3def-4661-bf74-4a540fedde0a could not be found. Apr 20 18:27:12.431886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Returning 404 to user: Instance 291eea25-3def-4661-bf74-4a540fedde0a could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:27:12.433315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cec66133-8a60-426d-813b-4e7177151ec8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 404 len: 111 microversion: 2.1 time: 0.152803 Apr 20 18:27:12.434454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 345/680] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:12 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:27:12.446293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9e3b7f52-af3e-4a5e-9c9d-c1635a33d9c2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '.version_select at 0x7f1a177d41e0>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:12.484160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9e3b7f52-af3e-4a5e-9c9d-c1635a33d9c2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071073607" status: 202 len: 0 microversion: 2.1 time: 0.042576 Apr 20 18:27:12.484734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 336/681] 10.222.0.22 () {58 vars in 1211 bytes} [Tue Apr 20 18:27:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071073607 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:12.580860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:12.581537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:12.601437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.603031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.612024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.612794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.770606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-18fb492c-24d7-4d66-9a24-fafe8372029c req-dd7aee03-2849-47b1-8e46-bd71964020c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:12.773199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:12.773199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:12.803770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-18fb492c-24d7-4d66-9a24-fafe8372029c req-dd7aee03-2849-47b1-8e46-bd71964020c4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:12.811500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-18fb492c-24d7-4d66-9a24-fafe8372029c req-dd7aee03-2849-47b1-8e46-bd71964020c4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:12.864645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-18fb492c-24d7-4d66-9a24-fafe8372029c req-dd7aee03-2849-47b1-8e46-bd71964020c4 service nova] Creating event network-changed:d04185fb-b7be-4560-98ad-57be1b019e17 for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 on hv-cinder-78693 Apr 20 18:27:12.894235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-18fb492c-24d7-4d66-9a24-fafe8372029c req-dd7aee03-2849-47b1-8e46-bd71964020c4 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126976 Apr 20 18:27:12.895170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 337/682] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:13.342359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:13.344306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:13.354360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:13.355003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:13.355964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:13.356539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:13.511504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:13.520842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b47133b8-f065-43b6-9a60-a72eeb202cb8 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1277 microversion: 2.1 time: 0.183469 Apr 20 18:27:13.521957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 338/683] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:13 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:27:13.533618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:13.544352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:13.546050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:13.547271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7e3baa2a-6022-499e-9f8e-1e47e647120f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.971316 Apr 20 18:27:13.547870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 346/684] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:12 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:14.540347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:14.541696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:14.550400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:14.551219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:14.552299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:14.553515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:14.566529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:14.567388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:14.588140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:14.589281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:14.591925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:14.592275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:15.080245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:15.090647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:15.092349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:15.093557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dbab075e-e488-40cd-9271-80511e3d1d0b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.532024 Apr 20 18:27:15.094363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 347/685] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:14 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:15.384641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:15.397657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a99bf494-ed3a-47c6-95e8-7f8222f17a19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.857649 Apr 20 18:27:15.398614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 339/686] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:14 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:15.440050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-687739ab-6622-44b9-bc89-8ab9f1aa2b78 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: .version_select at 0x7f1a175a9378>, body: {"keypair": {"name": "tempest-keypair-1439478290"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:15.465988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-687739ab-6622-44b9-bc89-8ab9f1aa2b78 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:15.470379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-687739ab-6622-44b9-bc89-8ab9f1aa2b78 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for user 822060e8b68d4cbc97a4331cd4383a88 and project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:15.825719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-11549eef-da3e-4baf-b9db-40b43156bbc3 req-c19df2bf-2db1-4508-a1ca-9a4a0847e65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d98504-4ae7-40fa-81b2-f0bfb4dcd308", "tag": "4388147c-b22b-4841-b2e7-0f8ecb8e086f"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:15.828042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:15.828042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:15.839163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-11549eef-da3e-4baf-b9db-40b43156bbc3 req-c19df2bf-2db1-4508-a1ca-9a4a0847e65c service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:15.839824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-11549eef-da3e-4baf-b9db-40b43156bbc3 req-c19df2bf-2db1-4508-a1ca-9a4a0847e65c service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:15.866048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-11549eef-da3e-4baf-b9db-40b43156bbc3 req-c19df2bf-2db1-4508-a1ca-9a4a0847e65c service nova] Creating event network-changed:4388147c-b22b-4841-b2e7-0f8ecb8e086f for instance 45d98504-4ae7-40fa-81b2-f0bfb4dcd308 on hv-cinder-78693 Apr 20 18:27:15.869760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-687739ab-6622-44b9-bc89-8ab9f1aa2b78 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:15.871049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-11549eef-da3e-4baf-b9db-40b43156bbc3 req-c19df2bf-2db1-4508-a1ca-9a4a0847e65c service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052026 Apr 20 18:27:15.871681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 340/687] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:15.873864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-687739ab-6622-44b9-bc89-8ab9f1aa2b78 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for user 822060e8b68d4cbc97a4331cd4383a88 and project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'key_pairs'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:15.887623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-687739ab-6622-44b9-bc89-8ab9f1aa2b78 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.451826 Apr 20 18:27:15.888269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 348/688] 10.222.0.22 () {60 vars in 1148 bytes} [Tue Apr 20 18:27:15 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:16.113841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:16.114730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:16.123798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:16.124386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:16.125280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:16.125778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:16.417310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:16.418172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:16.427291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:16.428572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:16.429588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:16.430199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:16.471389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:16.482089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:16.484420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:16.486057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c0628427-5db6-47a6-8d85-b759dd729f3d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.377016 Apr 20 18:27:16.487264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 341/689] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:16 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:16.872193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:16.882040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e7986fb1-e2ee-4847-9ebd-c8f81f672242 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.469956 Apr 20 18:27:16.882806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 349/690] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:16 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:27:17.505508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:17.506175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:17.514144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:17.514730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:17.515566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:17.516058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:17.832176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:17.842196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:17.843902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:17.845029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-11455ecd-3e93-4096-8163-357f614e0088 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.343626 Apr 20 18:27:17.845633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 342/691] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:17 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:17.887486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-820544024", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ca6af4a-0ad6-45b9-a16f-a46c80d90308"}], "security_groups": [{"name": "tempest-securitygroup--1634567387"}], "key_name": "tempest-keypair-1439478290", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:17.900654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:17.901327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:17.909419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:17.909917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:17.910861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:17.911477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:18.023556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] validate_networks() for [('4ca6af4a-0ad6-45b9-a16f-a46c80d90308', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:27:18.125775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:18.134659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a0685513-a528-48ff-ada9-74003a60d8f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.238413 Apr 20 18:27:18.135272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 343/692] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:17 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:18.834774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:27:18.835248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:27:18.835827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:27:18.836283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Image pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:27:18.836742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:27:18.845588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:18.846034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:18.846933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:18.847416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:18.864156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:18.864826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:18.866111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:27:18.870373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Getting quotas for user 822060e8b68d4cbc97a4331cd4383a88 and project 5d2e923accea4ab49bf0e323d95333eb. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:27:18.872679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:18.873401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:18.874240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:18.874787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:18.881817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Going to run 1 instances... {{(pid=100569) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:27:18.884430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100569) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:27:18.936059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8fd50832-86e1-43a4-a655-1e0f47673f01 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.053250 Apr 20 18:27:18.936796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 350/693] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:27:17 2021] POST /compute/v2.1/servers => generated 402 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:27:18.947490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c1422f04-c58e-4662-ac99-00c767e58639 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:18.948268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c1422f04-c58e-4662-ac99-00c767e58639 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:19.030711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c1422f04-c58e-4662-ac99-00c767e58639 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:19.041766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c1422f04-c58e-4662-ac99-00c767e58639 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1237 microversion: 2.1 time: 0.098356 Apr 20 18:27:19.052692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 351/694] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:18 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:27:19.115988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:19.125818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:19.127563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:19.128739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f946e214-2262-4f6d-b08e-79e5cff9fd1e tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.268666 Apr 20 18:27:19.129333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 344/695] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:18 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:27:19.153160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:19.154269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:19.163903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:19.164398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:19.165308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:19.165796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:19.390399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:19.400164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-42f0093d-ad88-4aea-97ca-295fc38857eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.251462 Apr 20 18:27:19.400992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 352/696] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:19 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:19.535059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-04d37cff-d636-46b3-bd05-b4d2d18aa94b req-ef528055-999c-4fb4-920d-6c2afe3c8cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "name": "network-vif-plugged", "status": "completed", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:19.536831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:19.536831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:19.557847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-04d37cff-d636-46b3-bd05-b4d2d18aa94b req-ef528055-999c-4fb4-920d-6c2afe3c8cf9 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:19.558355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-04d37cff-d636-46b3-bd05-b4d2d18aa94b req-ef528055-999c-4fb4-920d-6c2afe3c8cf9 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:19.576378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-04d37cff-d636-46b3-bd05-b4d2d18aa94b req-ef528055-999c-4fb4-920d-6c2afe3c8cf9 service nova] Creating event network-vif-plugged:d04185fb-b7be-4560-98ad-57be1b019e17 for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 on hv-cinder-78693 Apr 20 18:27:19.581472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-04d37cff-d636-46b3-bd05-b4d2d18aa94b req-ef528055-999c-4fb4-920d-6c2afe3c8cf9 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050343 Apr 20 18:27:19.582136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 345/697] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:20.060162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:20.060830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:20.068818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:20.069326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:20.070147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:20.070669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:20.149062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:20.149830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:20.158061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:20.158601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:20.159440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:20.159940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:20.195241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:20.204559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e4e3d651-3cf2-4dd4-ae1a-590f6df76a8d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1289 microversion: 2.1 time: 0.148389 Apr 20 18:27:20.205216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 353/698] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:20 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:20.377414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:20.387338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:20.389023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:20.390202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8e135790-b02f-438a-8847-c9aa4bd4505c tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1407 microversion: 2.20 time: 0.245956 Apr 20 18:27:20.390913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 346/699] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:20 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:20.418309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:20.419008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:20.427042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:20.427544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:20.428398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:20.428887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:20.725896 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:20.734873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6a8c8ff1-cb5d-4c1c-9260-220d0a701b57 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.320900 Apr 20 18:27:20.735498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 354/700] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:20 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:21.223689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:21.225593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:21.234249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.234784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.235649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.236141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.409682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:21.410381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:21.428630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.429087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.431655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.432158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.743715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:21.760895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5b3922d0-83de-44e7-a4f0-7eb5f3aff3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.541718 Apr 20 18:27:21.761543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 347/701] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:21 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:21.766374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-858d9db1-75d9-474d-9a30-3b46d4b89e05 req-7cf7e652-906d-4622-90ee-bfc527721488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d98504-4ae7-40fa-81b2-f0bfb4dcd308", "name": "network-vif-plugged", "status": "completed", "tag": "4388147c-b22b-4841-b2e7-0f8ecb8e086f"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:21.768174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:21.768174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:21.788203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-858d9db1-75d9-474d-9a30-3b46d4b89e05 req-7cf7e652-906d-4622-90ee-bfc527721488 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.788806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-858d9db1-75d9-474d-9a30-3b46d4b89e05 req-7cf7e652-906d-4622-90ee-bfc527721488 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.808388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-858d9db1-75d9-474d-9a30-3b46d4b89e05 req-7cf7e652-906d-4622-90ee-bfc527721488 service nova] Creating event network-vif-plugged:4388147c-b22b-4841-b2e7-0f8ecb8e086f for instance 45d98504-4ae7-40fa-81b2-f0bfb4dcd308 on hv-cinder-78693 Apr 20 18:27:21.816413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-858d9db1-75d9-474d-9a30-3b46d4b89e05 req-7cf7e652-906d-4622-90ee-bfc527721488 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053298 Apr 20 18:27:21.816745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 348/702] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:21.822504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:21.823458 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:21.832466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.833121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.834529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:21.835023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:21.957948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:21.970811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:21.973069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:21.975743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-09f0729e-ac89-4e1f-8c6e-3657763052dd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1598 microversion: 2.20 time: 0.569026 Apr 20 18:27:21.976561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 355/703] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:27:21 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1598 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:21.994743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:21.995231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:22.003835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:22.004599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:22.005608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:22.006285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:22.119274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:22.128498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1e8c0269-cba0-42cf-93fc-13fa5cc017ea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.310230 Apr 20 18:27:22.129345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 349/704] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:21 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:22.222631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-58022b6c-96c6-4771-9a25-fff0a1af3db9 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.232013 Apr 20 18:27:22.223274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 356/705] 10.222.0.22 () {60 vars in 1306 bytes} [Tue Apr 20 18:27:21 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:27:22.779407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:22.780190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:22.789146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:22.789755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:22.790720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:22.791281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:23.016646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:23.026405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1abf59a2-4949-4d3b-a176-30aec60878be tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.251189 Apr 20 18:27:23.027166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 350/706] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:22 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:23.148365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:23.149034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:23.158011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:23.158546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:23.159597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:23.159863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:23.748975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-cd97ef49-6d34-4b23-8d81-93c7ecff0a54 req-dbe468d0-44b4-4f41-98f1-94b108966404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdafac6-0e5f-4d11-a71a-071aaad3f92e", "tag": "eb43c1e2-ebae-4195-ac80-55e62d766ee3"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:23.759780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:23.759780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:23.774470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:23.797136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ee8e803-b8cb-4088-8861-815d104b9d1f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1319 microversion: 2.1 time: 0.653388 Apr 20 18:27:23.797803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 357/707] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:23 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:23.801001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-cd97ef49-6d34-4b23-8d81-93c7ecff0a54 req-dbe468d0-44b4-4f41-98f1-94b108966404 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:23.802247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-cd97ef49-6d34-4b23-8d81-93c7ecff0a54 req-dbe468d0-44b4-4f41-98f1-94b108966404 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:23.824955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-cd97ef49-6d34-4b23-8d81-93c7ecff0a54 req-dbe468d0-44b4-4f41-98f1-94b108966404 service nova] Creating event network-changed:eb43c1e2-ebae-4195-ac80-55e62d766ee3 for instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e on hv-cinder-78693 Apr 20 18:27:23.831449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-cd97ef49-6d34-4b23-8d81-93c7ecff0a54 req-dbe468d0-44b4-4f41-98f1-94b108966404 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086380 Apr 20 18:27:23.832264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 351/708] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:24.044723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:24.045394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:24.053910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:24.054410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:24.055316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:24.055859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:24.816124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:24.816903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:24.825191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:24.825689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:24.826550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:24.827059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:25.040942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:25.044999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:25.050396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bfaa966f-1afb-479c-b84d-9da3244219af tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1509 microversion: 2.1 time: 0.238795 Apr 20 18:27:25.055473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 352/709] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:24 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:25.055649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-31dc367f-84ab-4c71-a4b4-9e13a9aea292 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 1.013317 Apr 20 18:27:25.055649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 358/710] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:24 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:25.472818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:25.473864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:25.481825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:25.482332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:25.483205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:25.483693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:25.631851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-010ac028-f7f4-408c-8a89-8c5859ceade7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.162400 Apr 20 18:27:25.633057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 353/711] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:25 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:25.854515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-b4206b2a-1b80-443a-a677-619df9e87cde req-4153f707-6311-4441-bd5a-dc947fe0ea77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:25.856888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:25.856888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:25.866714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b4206b2a-1b80-443a-a677-619df9e87cde req-4153f707-6311-4441-bd5a-dc947fe0ea77 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:25.867723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b4206b2a-1b80-443a-a677-619df9e87cde req-4153f707-6311-4441-bd5a-dc947fe0ea77 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:25.887454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-b4206b2a-1b80-443a-a677-619df9e87cde req-4153f707-6311-4441-bd5a-dc947fe0ea77 service nova] Creating event network-changed:d04185fb-b7be-4560-98ad-57be1b019e17 for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 on hv-cinder-78693 Apr 20 18:27:25.893684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-b4206b2a-1b80-443a-a677-619df9e87cde req-4153f707-6311-4441-bd5a-dc947fe0ea77 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043191 Apr 20 18:27:25.894587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 359/712] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:26.074096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:26.075545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:26.087836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:26.088775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:26.089963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:26.090670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:26.567017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:26.576434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-667e050a-74e4-46fb-9847-a9dbdc6a1602 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.508599 Apr 20 18:27:26.577951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 354/713] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:26 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:26.645813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:26.647784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:26.656155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:26.656750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:26.657784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:26.658354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:26.799716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-12f7c510-88f2-42d3-a9d2-11c14364e976 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.159498 Apr 20 18:27:26.801602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 360/714] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:26 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:27.595156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:27.595879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:27.604693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:27.605202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:27.606040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:27.606557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:27.811897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:27.813352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:27.825744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:27.828392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:27.828904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:27.829760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:27.830251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:27.835399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-111b7e48-1fdc-4ac5-841e-53841bbe5f17 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.244421 Apr 20 18:27:27.836154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 355/715] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:27 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:27.989207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-55563ce4-f80d-4dfa-9c33-b76c94d3ee68 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.181560 Apr 20 18:27:27.990410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 361/716] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:27 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:28.853669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:28.854259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:28.862030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:28.862572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:28.863397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:28.863882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:29.008688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:29.008688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:29.012248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:29.012760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:29.013595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:29.014087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:29.151840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-57153892-866e-44bb-8b74-f48029c32613 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.153756 Apr 20 18:27:29.152440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 362/717] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:28 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:27:29.155532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:29.165454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3aa7fa77-e97e-411d-9bb3-47e0edd686e0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.315903 Apr 20 18:27:29.166404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 356/718] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:28 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:30.165093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:30.166237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:30.174941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:30.175451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:30.176291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:30.176838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:30.184904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:30.186001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:30.195738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:30.196180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:30.197056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:30.197557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:30.431973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:30.441700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-02f66ac2-209e-4a1f-a9cd-88ca8e066989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.261503 Apr 20 18:27:30.442543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 357/719] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:30 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:30.443046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3602e0e6-3a63-49bc-9be3-05bee1be8755 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.283214 Apr 20 18:27:30.443778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 363/720] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:30 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:31.455254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:31.456788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:31.462827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:31.463944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:31.465107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:31.465615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:31.466492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:31.466981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:31.472629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:31.473121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:31.473958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:31.474444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:31.618148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c4ff6075-4529-4b54-8856-4b93fb896aa7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.166793 Apr 20 18:27:31.621497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 358/721] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:31 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:31.624278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-6218297c-7671-42c6-8369-7df25a469b1d req-e8a34a38-3a79-4039-8e12-c2edeba48b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdafac6-0e5f-4d11-a71a-071aaad3f92e", "name": "network-vif-plugged", "status": "completed", "tag": "eb43c1e2-ebae-4195-ac80-55e62d766ee3"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:31.626043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:31.626043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:31.636226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6218297c-7671-42c6-8369-7df25a469b1d req-e8a34a38-3a79-4039-8e12-c2edeba48b5a service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:31.636718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6218297c-7671-42c6-8369-7df25a469b1d req-e8a34a38-3a79-4039-8e12-c2edeba48b5a service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:31.654831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-6218297c-7671-42c6-8369-7df25a469b1d req-e8a34a38-3a79-4039-8e12-c2edeba48b5a service nova] Creating event network-vif-plugged:eb43c1e2-ebae-4195-ac80-55e62d766ee3 for instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e on hv-cinder-78693 Apr 20 18:27:31.659904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-6218297c-7671-42c6-8369-7df25a469b1d req-e8a34a38-3a79-4039-8e12-c2edeba48b5a service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039693 Apr 20 18:27:31.660673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 359/722] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:31.693647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:31.704560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6af7b0fa-ffd9-42ce-ab10-4f9e5a27362d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.247091 Apr 20 18:27:31.705405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 364/723] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:31 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:32.630546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:32.631678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:32.641053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:32.641564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:32.642430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:32.642959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:32.723559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:32.724222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:32.732510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:32.733007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:32.733829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:32.734315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:32.777234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6330c101-d2ba-4efd-b57c-60e8afc7d471 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.151136 Apr 20 18:27:32.780917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 360/724] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:32 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:32.956433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:32.967132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c0be989d-e571-499e-9a14-829eaf5fded9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1363 microversion: 2.1 time: 0.247814 Apr 20 18:27:32.967798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 365/725] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:32 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:33.790974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:33.792166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:33.800903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:33.801421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:33.802260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:33.802801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:33.938766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-803b6803-cfbb-4f76-96f2-a5c3def642e8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 14 microversion: 2.20 time: 0.153090 Apr 20 18:27:33.939476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 361/726] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:33 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:33.985083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:33.985765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:33.994613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:33.995108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:33.995960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:33.996455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:34.211765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:27:34.220518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f983de45-f56f-41a2-b7cf-59fc07d5baa3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1549 microversion: 2.1 time: 0.239500 Apr 20 18:27:34.221117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 366/727] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:27:33 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:34.238261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:34.238935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:34.248653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:34.249240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:34.250130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:34.250660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:34.411520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c7eafbf-4ec3-471f-8bb3-4108aac3db3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177644 Apr 20 18:27:34.412177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 362/728] 10.222.0.22 () {58 vars in 1265 bytes} [Tue Apr 20 18:27:34 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:34.949870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:34.950984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:34.959550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:34.960053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:34.960889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:34.961378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:35.100370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b496bd73-ebb4-4dd0-92c9-bb4b0ea10a85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 6882 microversion: 2.20 time: 0.154328 Apr 20 18:27:35.101667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 367/729] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:34 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 6882 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:36.113698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:36.114674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:36.123157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:36.123661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:36.124488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:36.124980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:36.209974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:36.211316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:36.219872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:36.220383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:36.221230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:36.221757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:36.266002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5f8b591b-b82f-4de2-91ff-a977913d5346 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 15025 microversion: 2.20 time: 0.156722 Apr 20 18:27:36.270168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 363/730] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:36 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 15025 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:36.272591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-23fe95d1-587e-40c1-b9b6-4e4da96bb95c req-ae243461-9607-4b96-9a2d-350b402d9f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdafac6-0e5f-4d11-a71a-071aaad3f92e", "tag": "eb43c1e2-ebae-4195-ac80-55e62d766ee3"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:36.278249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:27:36.278249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:27:36.284622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-23fe95d1-587e-40c1-b9b6-4e4da96bb95c req-ae243461-9607-4b96-9a2d-350b402d9f52 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:36.285126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-23fe95d1-587e-40c1-b9b6-4e4da96bb95c req-ae243461-9607-4b96-9a2d-350b402d9f52 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:36.304642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-23fe95d1-587e-40c1-b9b6-4e4da96bb95c req-ae243461-9607-4b96-9a2d-350b402d9f52 service nova] Creating event network-changed:eb43c1e2-ebae-4195-ac80-55e62d766ee3 for instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e on hv-cinder-78693 Apr 20 18:27:36.309689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-23fe95d1-587e-40c1-b9b6-4e4da96bb95c req-ae243461-9607-4b96-9a2d-350b402d9f52 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041555 Apr 20 18:27:36.310340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 364/731] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:27:36.396043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fc99c16a-2af0-4bed-93e6-e902992faf83 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.192123 Apr 20 18:27:36.396796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 368/732] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:36 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:27:37.278367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:37.279527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:37.288629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:37.289210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:37.290046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:37.290568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:37.408610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:37.409777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:37.419210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:37.419715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:37.420545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:37.421030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:37.434302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a21022a5-2824-486b-841b-ec2e3a54daa1 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 18102 microversion: 2.20 time: 0.160271 Apr 20 18:27:37.435349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 365/733] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:37 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 18102 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:37.543643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7ee55b3d-ec80-495e-87fd-5f467e78d788 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.139380 Apr 20 18:27:37.544514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 369/734] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:37 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:27:38.447271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:38.448414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:38.457039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:38.457553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:38.458391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:38.458921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:38.556091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:38.557145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:38.565720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:38.566226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:38.567077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:38.567564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:38.583829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d12d7e45-fde7-4fb5-a7f6-f9d9bc93593a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 19342 microversion: 2.20 time: 0.140901 Apr 20 18:27:38.588336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 366/735] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:38 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 19342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:38.697249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b318f548-04cb-4285-8a58-5311255ab08c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.145528 Apr 20 18:27:38.697917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 370/736] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:38 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:27:39.597265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:39.598512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:39.607085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:39.607601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:39.608435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:39.608935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:39.709435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:39.711299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:39.719821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:39.720321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:39.721149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:39.721632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:39.749834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ff414178-0953-495d-8cea-1729f60f3db2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 21519 microversion: 2.20 time: 0.156881 Apr 20 18:27:39.750646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 367/737] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:39 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 21519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:39.871009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ea48b8d-582f-4b53-8e6a-6222048c8128 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.165725 Apr 20 18:27:39.871658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 371/738] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:39 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:40.763058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:40.764239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:40.773366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:40.773871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:40.774736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:40.775233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:40.882908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:40.884022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:40.892492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:40.893002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:40.893841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:40.894343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:40.925058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c815b5c-24ca-4c68-9dfe-f5ea26adf86f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 22969 microversion: 2.20 time: 0.166461 Apr 20 18:27:40.925758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 368/739] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:40 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 22969 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:41.049558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91636f98-77d5-476e-94eb-4842c8b8f6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.171541 Apr 20 18:27:41.053043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 372/740] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:40 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:41.938025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:41.939251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:41.947938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:41.948471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:41.949260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:41.949755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:42.061514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:42.062711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:42.071295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:42.071812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:42.072651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:42.073144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:42.094865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-31db4fd7-e5a1-4474-a483-169fe6aa9cbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 23223 microversion: 2.20 time: 0.161088 Apr 20 18:27:42.099307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 369/741] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:41 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 23223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:42.208071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6df733b5-e13b-4237-b64c-24aa4f6917c3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.150955 Apr 20 18:27:42.208767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 373/742] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:42 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:43.108760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:43.109978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:43.119279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:43.119788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:43.120623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:43.121121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:43.220310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:43.221475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:43.230639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:43.231147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:43.231983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:43.232480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:43.255171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e6a41f50-7609-4639-957a-37934af3eef8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 24528 microversion: 2.20 time: 0.150663 Apr 20 18:27:43.259601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 370/743] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:43 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 24528 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:43.299882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0cf184f-ea4f-4b17-8d2a-3a4ebdaada76", "device": "/dev/sdb"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:43.301695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:43.310865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:43.311368 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:43.312199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:43.312693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:43.355242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e0b678c0-c190-4d18-9941-ba899072120d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.139294 Apr 20 18:27:43.356065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 374/744] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:43 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:27:43.690641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bdfb377d-225d-407e-8c4a-e5fdf1db22b0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "POST /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395100 Apr 20 18:27:43.691315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 371/745] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:27:43 2021] POST /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:27:44.268470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:44.269656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:44.278182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:44.278728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:44.279566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:44.280064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:44.368489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:44.369708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:44.378442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:44.378977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:44.379821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:44.380317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:44.424455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f5fe7ace-0d02-4cf1-bac1-4049da31bae7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 26003 microversion: 2.20 time: 0.160171 Apr 20 18:27:44.429065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 375/746] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:44 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 26003 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:44.508100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-39fafab2-d7bb-4941-9a50-bbb33da326a0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.144613 Apr 20 18:27:44.508719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 372/747] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:44 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:45.437136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:45.438276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:45.447176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:45.447686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:45.448532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:45.449026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:45.520361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:45.521495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:45.529981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:45.530502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:45.531378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:45.531873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:45.590907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2379f634-a170-4bea-a676-25cb1b19a627 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 27184 microversion: 2.20 time: 0.158102 Apr 20 18:27:45.591843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 376/748] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:45 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 27184 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:45.653885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3dc4f19f-5df7-4dfe-93d2-b2529a079a97 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.137926 Apr 20 18:27:45.654588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 373/749] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:45 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:46.604248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:46.605379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:46.613989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:46.614523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:46.615357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:46.616355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:46.666305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:46.667490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:46.676168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:46.676683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:46.677532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:46.678030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:46.769409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7970f718-0f87-4c29-9a7c-79718e34326d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 27852 microversion: 2.20 time: 0.169617 Apr 20 18:27:46.770129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 377/750] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:46 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 27852 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:46.822748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3a0bcc3b-aba1-4a0e-b858-6e779d9daf8f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.160892 Apr 20 18:27:46.823444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 374/751] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:46 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:47.834831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:47.835984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:47.844455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:47.844967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:47.845800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:47.846268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:47.899361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:47.900774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:47.908821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:47.909327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:47.910168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:47.910706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:47.981389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-577ec880-79d1-4bcf-9f58-ab53526b2a1a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 14 microversion: 2.1 time: 0.151378 Apr 20 18:27:47.982121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 375/752] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:47 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:27:48.051164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ad1d9a60-64ed-45bb-9d9c-69b4607c8b7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28219 microversion: 2.20 time: 0.272810 Apr 20 18:27:48.051801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 378/753] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:47 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28219 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:27:48.994068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:48.995245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:49.003843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:49.004360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:49.005201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:49.005699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:49.064065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:49.065209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:49.074352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:49.074897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:49.075748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:49.076249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:49.148274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-39f26297-b554-47b2-8d88-734b60da2989 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 8911 microversion: 2.1 time: 0.158957 Apr 20 18:27:49.148987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 376/754] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:48 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 8911 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:27:49.220112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-37e5ee7d-a43f-409a-aa38-3495d6caf079 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28219 microversion: 2.20 time: 0.160341 Apr 20 18:27:49.221022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 379/755] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:49 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:27:50.161115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:50.162172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:50.170998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:50.171557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:50.172391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:50.172884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:50.234014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:50.235191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:50.244128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:50.244638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:50.245485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:50.245986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:50.314810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7ba81526-61cf-48ae-82d8-89722921bc84 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 15025 microversion: 2.1 time: 0.158190 Apr 20 18:27:50.315680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 377/756] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:50 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 15025 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:27:50.413627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-59b0aefe-a7f3-4b04-a94e-569ac7b9feb6 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28509 microversion: 2.20 time: 0.184440 Apr 20 18:27:50.414255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 380/757] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:50 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:27:51.328496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:51.329620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:51.338131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:51.338672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:51.339501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:51.339992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:51.426126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:51.427302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:51.436468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:51.436977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:51.437820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:51.438319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:51.470214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-337183ff-e0fe-4eeb-b43c-87413c134d27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 18449 microversion: 2.1 time: 0.146031 Apr 20 18:27:51.471116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 378/758] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:51 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 18449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:27:51.574868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bde74871-2c48-47e8-9140-63054ee54130 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28677 microversion: 2.20 time: 0.153023 Apr 20 18:27:51.579099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 381/759] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:51 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:27:52.538953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:52.540084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:52.548498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:52.549060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:52.549911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:52.550413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:52.588153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:52.589442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:52.598001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:52.598553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:52.599384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:52.599872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:54.858450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1fabc69a-49a0-42cf-9a2b-b500adedf568 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 24125 microversion: 2.1 time: 2.379750 Apr 20 18:27:54.859178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 379/760] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:52 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 24125 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:27:54.885926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-68594020-9c79-4870-9a3b-19e7adb00fd2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28677 microversion: 2.20 time: 2.302080 Apr 20 18:27:54.886636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 382/761] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:52 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28677 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:27:55.871337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:55.872470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:55.881081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:55.882095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:55.882944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:55.883435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:55.898986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:55.900116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:55.908614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:55.909122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:55.909954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:55.910448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:56.036925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9b662d4d-695e-4804-bc48-97e320396a3a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 25281 microversion: 2.1 time: 0.169796 Apr 20 18:27:56.037703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 380/762] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:55 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 25281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:27:56.066648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8e01564-2f7f-4528-ba4b-979e9cc86624 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28677 microversion: 2.20 time: 0.172476 Apr 20 18:27:56.067481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 383/763] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:55 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:27:57.050633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:57.051763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:57.060391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:57.060903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:57.061956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:57.062276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:57.080146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:27:57.081264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:27:57.090386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:57.090922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:57.091752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:27:57.092256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:27:59.402148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f9bfe4ae-78e2-4a88-9a3f-09f2d7a294e8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 27718 microversion: 2.1 time: 2.355949 Apr 20 18:27:59.402876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 381/764] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:27:57 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 27718 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:27:59.420204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2f6fbf7f-8a6b-455e-8b68-6ccc4aef539d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28677 microversion: 2.20 time: 2.344340 Apr 20 18:27:59.420918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 384/765] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:27:57 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28677 bytes in 2346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:00.415751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:00.416859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:00.425450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:00.425964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:00.426830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:00.427331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:00.432701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:00.433831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:00.442521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:00.443038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:00.444538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:00.445039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:00.573077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6e3c2bb7-a580-4c26-9484-423bb3c12230 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28228 microversion: 2.1 time: 0.161995 Apr 20 18:28:00.577249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 382/766] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:00 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28228 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:00.588813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-90da5aec-052c-4b05-8716-ff611c999d4b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28677 microversion: 2.20 time: 0.160521 Apr 20 18:28:00.593009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 385/767] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:00 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:01.586862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:01.588007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:01.596615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:01.597129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:01.597970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:01.598486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:01.602304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:01.603510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:01.611969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:01.612469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:01.613295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:01.613781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:03.777192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-75cb52bf-5d44-4d1c-bb01-2982ac5155d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28228 microversion: 2.1 time: 2.195269 Apr 20 18:28:03.778267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 383/768] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:01 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28228 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:03.803803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-813accc4-ac0d-4926-a879-afc1ff7f1d14 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 28677 microversion: 2.20 time: 2.205691 Apr 20 18:28:03.806405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 386/769] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:01 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 28677 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:04.790768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:04.791893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:04.800450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:04.800958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:04.801784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:04.802274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:04.816326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:04.817448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:04.826622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:04.827129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:04.827958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:04.828447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:04.940941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-04d880bc-e724-4d94-ad2a-e370503bf05c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28228 microversion: 2.1 time: 0.154840 Apr 20 18:28:04.941579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 384/770] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:04 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28228 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:04.981711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-98cd75c9-668e-486c-892e-4e5e0e684c29 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 30095 microversion: 2.20 time: 0.169778 Apr 20 18:28:04.983095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 387/771] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:04 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 30095 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:05.954105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:05.955561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:05.964649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:05.965169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:05.966004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:05.966553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:05.996002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:05.999079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:06.006024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:06.007124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:06.007968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:06.008465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:06.110349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f23641fa-bb07-43e9-93d4-f4abc51828f8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28228 microversion: 2.1 time: 0.160540 Apr 20 18:28:06.115212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 385/772] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:05 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:06.152062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6d1e69d9-ebd3-4489-b018-0c81f4a38750 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 31910 microversion: 2.20 time: 0.161460 Apr 20 18:28:06.152813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 388/773] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:05 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 31910 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:07.123799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:07.124967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:07.133496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:07.133996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:07.134848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:07.135340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:07.166271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:07.167610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:07.176591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:07.177207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:07.178665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:07.179162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:07.293008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0661bb1e-fe6f-4788-af87-e399dad45e86 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28519 microversion: 2.1 time: 0.173481 Apr 20 18:28:07.293709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 386/774] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:07 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:07.327078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-023289cf-a125-4283-9ae8-bfaa6dd0110d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 33436 microversion: 2.20 time: 0.165796 Apr 20 18:28:07.328000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 389/775] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:07 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 33436 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:08.306686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:08.307856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:08.316468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:08.316983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:08.317813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:08.318308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:08.341033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:08.342730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:08.351950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:08.352463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:08.353328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:08.353825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:08.505529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6663ffd0-809b-4637-85c3-47ec7dfa7d6f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 34455 microversion: 2.20 time: 0.168970 Apr 20 18:28:08.509897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 390/776] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:08 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 34455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:28:08.512712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:08.513350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:08.522273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:08.522823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:08.523656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:08.524143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:08.594539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8bf498c-c435-4507-a692-92ed03d4d089 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28686 microversion: 2.1 time: 0.292643 Apr 20 18:28:08.595458 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 387/777] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:08 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28686 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:08.695638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lazy-loading 'services' on Instance uuid 45d98504-4ae7-40fa-81b2-f0bfb4dcd308 {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:28:08.833816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8bfc9aa-0436-451f-b2b8-ffab71330f54 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "DELETE /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308/os-volume_attachments/a0cf184f-ea4f-4b17-8d2a-3a4ebdaada76" status: 202 len: 0 microversion: 2.1 time: 0.325874 Apr 20 18:28:08.834705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 391/778] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:28:08 2021] DELETE /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308/os-volume_attachments/a0cf184f-ea4f-4b17-8d2a-3a4ebdaada76 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:09.518190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:09.519358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:09.527875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:09.528385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:09.529221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:09.529717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:09.608581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:09.609794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:09.618424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:09.618958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:09.619794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:09.620290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:09.679512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-83d751d8-f3c4-4983-9de3-d6b74c9e9fdd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 35344 microversion: 2.20 time: 0.164990 Apr 20 18:28:09.680214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 388/779] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:09 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 35344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:09.744477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ae5f8a3-c5f9-44ed-8eab-cb569fe0ec0a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28686 microversion: 2.1 time: 0.140647 Apr 20 18:28:09.745382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 392/780] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:09 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28686 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:10.049039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:10.049692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:10.058756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.059208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.060036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.060528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.126596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:28:10.237189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2698a23c-4f15-4329-9401-12ba2c09e4f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "DELETE /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 204 len: 0 microversion: 2.1 time: 0.192372 Apr 20 18:28:10.237877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 389/781] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:28:10 2021] DELETE /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:28:10.247817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:10.248587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:10.257121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.257629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.258495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.258991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.472523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:10.481452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bbf31d77-cddc-41cf-8fc7-e38c4808e0b4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1515 microversion: 2.1 time: 0.238109 Apr 20 18:28:10.482077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 393/782] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:10 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:10.693129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:10.694849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:10.702736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.703239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.704067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.704556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.758997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:10.760090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:10.768087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.768586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.769469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:10.769963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:10.837243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0b4fdaa5-8b1d-4c34-988a-62f491431411 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 36631 microversion: 2.20 time: 0.148485 Apr 20 18:28:10.837956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 390/783] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:10 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 36631 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:10.899657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-35909c26-7004-438e-a31c-8248634c2fc9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28686 microversion: 2.1 time: 0.145185 Apr 20 18:28:10.900340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 394/784] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:10 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28686 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:11.501459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:11.502240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:11.510853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:11.511369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:11.512201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:11.512697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:11.728881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:11.737640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d7eb037f-c98d-43d3-862c-1c7cfd483b09 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1515 microversion: 2.1 time: 0.240859 Apr 20 18:28:11.738248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 391/785] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:11 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:11.850679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:11.851814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:11.860376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:11.860874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:11.861695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:11.862177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:11.911064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:11.912189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:11.920334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:11.920844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:11.921725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:11.922220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:12.010434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f34ff284-ec1f-4420-8d3c-dcd2b27e4420 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 37842 microversion: 2.20 time: 0.164206 Apr 20 18:28:12.011254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 395/786] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:11 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 37842 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:12.063902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ed222a54-3b0d-480d-83da-5c59b97b122c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28686 microversion: 2.1 time: 0.156651 Apr 20 18:28:12.064515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 392/787] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:11 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:12.757308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:12.758235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:12.767093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:12.767604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:12.768490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:12.769072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:12.985381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:12.995038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-da7817cb-873b-4a18-bf98-b71946294606 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 200 len: 1515 microversion: 2.1 time: 0.242227 Apr 20 18:28:12.995871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 396/788] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:12 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:13.024366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:13.025684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:13.034234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:13.034798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:13.035566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:13.036055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:13.076264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:13.077304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:13.086055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:13.086606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:13.087920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:13.087920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:13.168329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0be372ba-1aec-4917-b580-26a85f39dc79 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 38234 microversion: 2.20 time: 0.149081 Apr 20 18:28:13.169332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 393/789] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:13 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 38234 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:13.227004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bf2ef515-b2a8-4a25-9d14-06dcf674aaee tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 28686 microversion: 2.1 time: 0.154432 Apr 20 18:28:13.228740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 397/790] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:13 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 28686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:13.229582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-0e8de786-f890-46bd-b247-179979b434d1 req-2529d825-b827-4f6e-9ef2-7737ada5b7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d98504-4ae7-40fa-81b2-f0bfb4dcd308", "name": "network-vif-deleted", "tag": "4388147c-b22b-4841-b2e7-0f8ecb8e086f"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:13.231264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:28:13.231264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:28:13.240353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0e8de786-f890-46bd-b247-179979b434d1 req-2529d825-b827-4f6e-9ef2-7737ada5b7a8 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:13.240856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0e8de786-f890-46bd-b247-179979b434d1 req-2529d825-b827-4f6e-9ef2-7737ada5b7a8 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:13.258278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-0e8de786-f890-46bd-b247-179979b434d1 req-2529d825-b827-4f6e-9ef2-7737ada5b7a8 service nova] Creating event network-vif-deleted:4388147c-b22b-4841-b2e7-0f8ecb8e086f for instance 45d98504-4ae7-40fa-81b2-f0bfb4dcd308 on hv-cinder-78693 Apr 20 18:28:13.263859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-0e8de786-f890-46bd-b247-179979b434d1 req-2529d825-b827-4f6e-9ef2-7737ada5b7a8 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093309 Apr 20 18:28:13.264439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 394/791] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:28:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:14.013744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:14.014528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 45d98504-4ae7-40fa-81b2-f0bfb4dcd308] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:14.023108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:14.023616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:14.024481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:14.024968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:14.076897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] HTTP exception thrown: Instance 45d98504-4ae7-40fa-81b2-f0bfb4dcd308 could not be found. Apr 20 18:28:14.077544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Returning 404 to user: Instance 45d98504-4ae7-40fa-81b2-f0bfb4dcd308 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:28:14.078423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ecded335-77b7-4433-bb51-37d75bf701a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308" status: 404 len: 111 microversion: 2.1 time: 0.069221 Apr 20 18:28:14.079028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 398/792] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:14 2021] GET /compute/v2.1/servers/45d98504-4ae7-40fa-81b2-f0bfb4dcd308 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:28:14.182737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:14.183867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:14.191909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:14.192422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:14.193260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:14.193752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:14.239496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:14.240687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:14.248737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:14.249346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:14.250261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:14.251323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:14.329752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1271f9d6-b2d0-4d23-8616-e14dccb3e258 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 38234 microversion: 2.20 time: 0.152513 Apr 20 18:28:14.334145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 395/793] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:14 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 38234 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:14.399163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4115ac8a-5617-4416-9943-8526715de7a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 29018 microversion: 2.1 time: 0.164062 Apr 20 18:28:14.399848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 399/794] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:14 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 29018 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:15.343577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:15.344715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:15.353860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:15.354369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:15.355226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:15.355720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:15.411702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:15.413810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:15.422964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:15.423648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:15.424526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:15.425036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:17.375269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-31e023ac-1dce-48a8-9a6f-098a5608c23a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 200 len: 38377 microversion: 2.20 time: 2.036534 Apr 20 18:28:17.375989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 396/795] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:15 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 38377 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:28:17.387237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:17.387885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:17.396527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:17.397039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:17.397877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:17.398373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:17.405195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5e548125-c5b6-4620-8e00-d9f2edf3a9d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 33654 microversion: 2.1 time: 1.997937 Apr 20 18:28:17.406977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 400/796] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:15 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 33654 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:17.459720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-49d79a03-b305-4bdb-ba71-507e296248e0 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/ips" status: 200 len: 150 microversion: 2.20 time: 0.076714 Apr 20 18:28:17.460361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 397/797] 10.222.0.22 () {60 vars in 1279 bytes} [Tue Apr 20 18:28:17 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/ips => generated 150 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:18.419010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:18.420160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:18.428796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:18.429299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:18.430138 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:18.430658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:18.561599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3c1e251b-8007-43cb-84db-2f6f9edbacec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 34662 microversion: 2.1 time: 0.146928 Apr 20 18:28:18.562287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 401/798] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:18 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 34662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:19.574728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:19.575781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:19.584867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:19.585377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:19.586251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:19.586795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:19.695575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:19.696268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:19.704877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:19.705383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:19.706222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:19.706746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:19.716485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d39773c7-00c9-4701-acc1-6787f746ad76 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 35799 microversion: 2.1 time: 0.145684 Apr 20 18:28:19.717487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 398/799] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:19 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 35799 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:19.770924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lazy-loading 'flavor' on Instance uuid 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:28:20.120262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-de5e98c8-f0a0-4ca6-922f-214f3bbbfcbb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 202 len: 0 microversion: 2.20 time: 0.429067 Apr 20 18:28:20.124460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 402/800] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:19 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:28:20.130802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:20.131643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:20.141150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:20.141649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:20.142490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:20.143182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:20.365281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:20.374765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:20.376449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:20.377673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c9256e7a-0268-4557-983c-1a4ec6b21aed tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.251573 Apr 20 18:28:20.378284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 399/801] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:20 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:20.729335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:20.730489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:20.739350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:20.739861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:20.740701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:20.741200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:21.397468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:21.398132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:21.406535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:21.407045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:21.407879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:21.408373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:21.618814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:21.628869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:21.630558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:21.631859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-86428e35-ae66-4f7b-abc6-ea1d3e37b515 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.238519 Apr 20 18:28:21.632470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 400/802] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:21 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:22.651628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:22.652300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:22.660177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:22.660685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:22.661516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:22.662007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:22.873227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:22.882650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:22.884261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:22.885481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-800e0516-9a86-4df3-8822-981911dac9ad tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.238158 Apr 20 18:28:22.886094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 401/803] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:22 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:28:23.196076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-06ed69ad-40bb-406e-b1c9-280272f7efdf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 38216 microversion: 2.1 time: 2.471495 Apr 20 18:28:23.196714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 403/804] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:20 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 38216 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:23.495820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2055123698", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "febb036d-f1e0-45d4-9851-73996168e7b8"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:23.565842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] validate_networks() for [('febb036d-f1e0-45d4-9851-73996168e7b8', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:28:23.905178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:23.905940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:23.915212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:23.915712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:23.916537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:23.917025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:24.132120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:24.141572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:24.143261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:24.144478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-db1f699b-d084-4236-978c-25c5ca41357a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.243999 Apr 20 18:28:24.145090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 404/805] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:23 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:28:24.151831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:28:24.152394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:28:24.152938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:28:24.153401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:28:24.153907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:28:24.163726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:24.164238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:24.165110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:24.165603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:24.183957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Getting quotas for project 1075f749f50d4350a332442d30431fe7. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:28:24.188223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Getting quotas for user 1a457d841519493cbd55b66075d311e7 and project 1075f749f50d4350a332442d30431fe7. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:28:24.199303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:28:24.201829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:28:24.207634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:24.208759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:24.217038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:24.217542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:24.218369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:24.218906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:24.251938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-75f31f8f-22ac-438c-bf71-ec194c37a60c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760157 Apr 20 18:28:24.252827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 402/806] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 18:28:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:28:24.263553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9cfdd5d4-986a-4d90-b015-5e1c00904cd6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:24.264154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9cfdd5d4-986a-4d90-b015-5e1c00904cd6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:24.344738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ce1b7cd7-db9f-4fb9-a774-f965a5964fdd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 38216 microversion: 2.1 time: 0.140658 Apr 20 18:28:24.345448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 405/807] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:24 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 38216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:24.348687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9cfdd5d4-986a-4d90-b015-5e1c00904cd6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:24.356967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9cfdd5d4-986a-4d90-b015-5e1c00904cd6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1219 microversion: 2.1 time: 0.097289 Apr 20 18:28:24.357571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 403/808] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:24 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:28:25.164889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:25.165574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:25.174109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:25.174643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:25.175478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:25.175964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:25.357450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:25.358652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:25.366673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:25.367180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:25.368011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:25.368504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:25.386318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:25.395917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:25.398244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:25.399759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c41e9a2-f7b1-478c-81db-b756bbebeb85 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.239746 Apr 20 18:28:25.400106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 406/809] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:25 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:25.404673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:25.405325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:25.413032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:25.413790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:25.414654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:25.415198 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:25.496136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-69ae9d2a-8b91-488e-803a-580440151663 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 38216 microversion: 2.1 time: 0.142608 Apr 20 18:28:25.496852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 404/810] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:25 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 38216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:28:25.547002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:25.556688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-295ddefc-70a2-4fb5-844a-9af966763cdc tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1271 microversion: 2.1 time: 0.155558 Apr 20 18:28:25.557313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 407/811] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:25 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:26.420415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:26.421191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:26.430641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.431203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.432045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.432544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.509602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:26.511196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:26.519468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.519999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.520872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.521337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.651795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1b69e29f-fc75-4dcf-9ffe-c386e78aace3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action" status: 200 len: 38345 microversion: 2.1 time: 0.146638 Apr 20 18:28:26.655065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 408/812] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 18:28:26 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/action => generated 38345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:26.658058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:26.658870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:26.667793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.668296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.669136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.669626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.760526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:26.771104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:26.773849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:26.775505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-52095ef9-03d0-4790-a10e-8426e540f155 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.359598 Apr 20 18:28:26.786513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 405/813] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:26 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:26.786513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:26.786513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:26.792189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.793167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.794880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:26.795533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:26.862725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a62fae46-6ab7-45fd-80da-ae53d6432b0b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/ips" status: 200 len: 146 microversion: 2.1 time: 0.085103 Apr 20 18:28:26.863353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 406/814] 10.222.0.22 () {58 vars in 1238 bytes} [Tue Apr 20 18:28:26 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/ips => generated 146 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:26.901173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:26.910575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e64c7aea-f19a-4eac-820e-90d631dfaffa tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.256761 Apr 20 18:28:26.911644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 409/815] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:26 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:27.629978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-7b83a944-34c6-4c2f-8de9-130177fc1b54 req-00fdd37e-6230-493c-9c4d-6e63871c9f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4ed2e4-f7d1-4c76-a041-11247df1d6a5", "tag": "9b8638c7-2dd4-44d0-8bb4-6c5f9e1c4bcc"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:27.632650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:28:27.632650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:28:27.643190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-7b83a944-34c6-4c2f-8de9-130177fc1b54 req-00fdd37e-6230-493c-9c4d-6e63871c9f12 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:27.644192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-7b83a944-34c6-4c2f-8de9-130177fc1b54 req-00fdd37e-6230-493c-9c4d-6e63871c9f12 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:27.664196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-7b83a944-34c6-4c2f-8de9-130177fc1b54 req-00fdd37e-6230-493c-9c4d-6e63871c9f12 service nova] Creating event network-changed:9b8638c7-2dd4-44d0-8bb4-6c5f9e1c4bcc for instance 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 on hv-cinder-78693 Apr 20 18:28:27.669203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-7b83a944-34c6-4c2f-8de9-130177fc1b54 req-00fdd37e-6230-493c-9c4d-6e63871c9f12 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044179 Apr 20 18:28:27.669865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 407/816] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:28:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:27.799739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:27.800585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:27.809527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:27.810041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:27.810956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:27.811453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:27.930274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:27.931088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:27.939773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:27.940289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:27.941145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:27.941643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:28.037507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:28.047497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:28.049169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:28.050385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8eb9c5e9-50f8-41d6-8f61-fc21dd0aa58f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.254958 Apr 20 18:28:28.051041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 410/817] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:27 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:28.372543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2914674-af64-46c5-947a-f889d61f493b"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:28.373858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:28.382361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:28.382932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:28.384237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:28.384739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:28.442985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:28.452599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e7027575-4eb0-4750-99c9-a6b8fb091468 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.526975 Apr 20 18:28:28.453590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 408/818] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:27 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:28.787074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-148291e3-d8d8-44e3-8b95-74d79ecbca60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418461 Apr 20 18:28:28.788704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 411/819] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:28:28 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:28:29.070111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:29.070805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:29.078812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:29.079319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:29.080150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:29.080645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:29.472126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:29.472897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:29.481739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:29.482247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:29.483136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:29.483629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:29.510161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:29.521348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:29.523085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:29.524322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bd4753c3-5dd2-4f33-8d99-f8335bba9e51 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.458833 Apr 20 18:28:29.524935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 409/820] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:29 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:29.699222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:29.708023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eef16f24-ea44-4f1d-a731-fe4e32025ce1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.240565 Apr 20 18:28:29.708656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 412/821] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:29 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:30.544533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:30.545196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:30.554043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:30.554586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:30.555422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:30.555940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:30.725671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:30.726426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:30.734373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:30.734997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:30.735941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:30.736522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:30.772233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:30.781902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:30.783849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:30.785068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-82356aa4-c73e-4f22-91a4-f1c1dfe72f32 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.244616 Apr 20 18:28:30.785661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 410/822] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:30 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:30.950532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:30.959958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-84313849-45aa-4171-b585-83f8d899b7d2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.237965 Apr 20 18:28:30.960590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 413/823] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:30 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:31.804955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:31.805659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:31.813607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:31.814115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:31.814974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:31.815469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:31.978693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:31.979446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:31.988360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:31.988946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:31.989857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:31.990532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:32.029455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:32.039734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:32.042087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:32.043490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ee3e2ea4-b5fc-4541-b6a3-c990c2f3dd38 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.242635 Apr 20 18:28:32.044278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 411/824] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:31 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:32.214651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:32.223312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f52ff5e7-1199-45eb-8237-b2c8c2f51f05 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.249351 Apr 20 18:28:32.223924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 414/825] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:31 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:33.063126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:33.063800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:33.072310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:33.072818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:33.073645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:33.074139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:33.241755 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:33.242570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:33.250575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:33.251197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:33.252107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:33.252678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:33.284771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:33.296605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:33.298490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:33.299747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c00080bc-1203-4b6b-8a72-2e3a6813eb12 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.240697 Apr 20 18:28:33.300397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 412/826] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:33 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:33.464950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:33.474123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fdeef48d-0a6c-421c-9c7e-2618bce86f01 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.236922 Apr 20 18:28:33.484929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 415/827] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:33 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:33.727242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-36734fc6-8da4-45c0-8e0f-47b49d7daa75 req-3403ef95-9309-4ce1-8060-e2f047cb17a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4ed2e4-f7d1-4c76-a041-11247df1d6a5", "name": "network-vif-plugged", "status": "completed", "tag": "9b8638c7-2dd4-44d0-8bb4-6c5f9e1c4bcc"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:33.729030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:28:33.729030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:28:33.737775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-36734fc6-8da4-45c0-8e0f-47b49d7daa75 req-3403ef95-9309-4ce1-8060-e2f047cb17a6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:33.738281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-36734fc6-8da4-45c0-8e0f-47b49d7daa75 req-3403ef95-9309-4ce1-8060-e2f047cb17a6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:33.756427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-36734fc6-8da4-45c0-8e0f-47b49d7daa75 req-3403ef95-9309-4ce1-8060-e2f047cb17a6 service nova] Creating event network-vif-plugged:9b8638c7-2dd4-44d0-8bb4-6c5f9e1c4bcc for instance 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 on hv-cinder-78693 Apr 20 18:28:33.763461 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-36734fc6-8da4-45c0-8e0f-47b49d7daa75 req-3403ef95-9309-4ce1-8060-e2f047cb17a6 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097396 Apr 20 18:28:33.764118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 413/828] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:28:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:34.320307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:34.320967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:34.328854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:34.329348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:34.330170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:34.330689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:34.494513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:34.495135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:34.503495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:34.504009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:34.504854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:34.505354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:34.547598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:34.557753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:34.559501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:34.560732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbb867d3-d67f-4af9-9079-9364e3710d81 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.245039 Apr 20 18:28:34.561379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 416/829] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:34 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:34.717992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:34.726789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fc48c619-7174-4391-b790-1a2a43cd5926 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1319 microversion: 2.1 time: 0.237709 Apr 20 18:28:34.727415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 414/830] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:34 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:28:35.581204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:35.581864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:35.590347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:35.590885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:35.591717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:35.592211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:35.744796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:35.745480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:35.768410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:35.768923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:35.769773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:35.770266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:35.817287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:35.827934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:35.829625 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:35.831028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-302ac0a7-8a61-49ca-83c4-5d54a0bda90a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.253911 Apr 20 18:28:35.831837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 417/831] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:35 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:35.984814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:35.994172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-98351b6b-b38f-46f0-b5b9-df331c92c5f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1509 microversion: 2.1 time: 0.253503 Apr 20 18:28:35.994840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 415/832] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:28:35 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:28:36.012633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "793b0677-7c16-46cb-a5e1-a59a237c0861", "device": "/dev/sdb"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:36.014435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:36.022791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.023295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.024130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.024617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.400696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-10b25227-2ce9-4a60-9218-58cb25edc866 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "POST /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391875 Apr 20 18:28:36.401360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 418/833] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:28:36 2021] POST /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:36.617866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:36.618974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:36.626789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.627287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.628119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.628613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.697014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-20cc6e3f-219e-4039-bbad-c00d59b9801f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083800 Apr 20 18:28:36.697623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 416/834] 10.222.0.22 () {58 vars in 1292 bytes} [Tue Apr 20 18:28:36 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:36.709601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:36.710295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:36.719398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.719898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.720729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.721216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.791995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ac3c6cf-8ed6-4b6e-86df-555fb72ae975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/c2914674-af64-46c5-947a-f889d61f493b" status: 200 len: 194 microversion: 2.1 time: 0.087420 Apr 20 18:28:36.792568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 419/835] 10.222.0.22 () {58 vars in 1403 bytes} [Tue Apr 20 18:28:36 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/c2914674-af64-46c5-947a-f889d61f493b => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:36.851132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:36.851805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:36.859583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.860091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:36.860913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:36.861401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:37.079243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:37.090116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:37.096434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:37.097887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bf001334-7d2a-4020-846d-055b893d0b69 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1743 microversion: 2.20 time: 0.250975 Apr 20 18:28:37.098922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 417/836] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:36 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:38.119152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:38.119825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:38.128523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:38.129033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:38.129879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:38.130370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:38.307703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "916a6012-c2b7-459c-8854-797e04f5d31e"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:38.309238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:38.317019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:38.317529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:38.318423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:38.319481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:38.352762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:38.362517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:38.364298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:38.365999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-deda98b9-a8b2-4071-801a-9866a6ef7396 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.252139 Apr 20 18:28:38.366544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 420/837] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:38 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:38.767902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e74a55a1-2ee2-4cb9-8e4d-a1604cf8ef5f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464456 Apr 20 18:28:38.768555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 418/838] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 18:28:38 2021] POST /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:39.386298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:39.387019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:39.395005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:39.395512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:39.396356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:39.397396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:39.641603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:39.652437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:39.654117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:39.655411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-318c0664-5521-435e-a4ed-c8997ac25aa4 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.273261 Apr 20 18:28:39.656238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 421/839] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:39 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:39.711472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-20e2f447-bbc3-47db-ad4d-81ae6fede042 req-bdea2e10-6230-4001-a8e9-b37800e6c909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "name": "network-vif-plugged", "status": "completed", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:39.713561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:28:39.713561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:28:39.724178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-20e2f447-bbc3-47db-ad4d-81ae6fede042 req-bdea2e10-6230-4001-a8e9-b37800e6c909 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:39.724733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-20e2f447-bbc3-47db-ad4d-81ae6fede042 req-bdea2e10-6230-4001-a8e9-b37800e6c909 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:39.743367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-20e2f447-bbc3-47db-ad4d-81ae6fede042 req-bdea2e10-6230-4001-a8e9-b37800e6c909 service nova] Creating event network-vif-plugged:d04185fb-b7be-4560-98ad-57be1b019e17 for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 on hv-cinder-78693 Apr 20 18:28:39.748973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-20e2f447-bbc3-47db-ad4d-81ae6fede042 req-bdea2e10-6230-4001-a8e9-b37800e6c909 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042712 Apr 20 18:28:39.750133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 419/840] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:28:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:28:40.674866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:40.675632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:40.684862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:40.685372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:40.686228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:40.686751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:40.942401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:40.956827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:40.958564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:40.959955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-81a10444-9e32-46cf-ae05-4a7a20403fe2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.289365 Apr 20 18:28:40.960751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 422/841] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:40 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:41.981416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:41.982192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:41.991020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:41.991544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:41.992410 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:41.992914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:42.227722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:42.237780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:42.239677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:42.240998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8205a958-8cb4-4e39-ace5-6a85ffa881fa tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.265046 Apr 20 18:28:42.253121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 420/842] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:41 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:43.265421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:43.266070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:43.281863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:43.282383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:43.283288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:43.288863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:43.577554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:43.588768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:43.590486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:43.591734 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6e6dae1f-0a41-4590-9463-2e68642cc351 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.330452 Apr 20 18:28:43.593497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 423/843] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:43 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:44.617379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:44.617969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:44.628494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:44.629291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:44.630303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:44.631009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:44.872193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:44.885005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:44.887111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:44.888332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ef833517-6645-4ec9-8945-90b710eea57a tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.278972 Apr 20 18:28:44.889431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 421/844] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:44 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:45.908701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:45.910310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:45.920002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:45.920517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:45.921366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:45.921859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:46.144524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:46.155116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:46.156723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:46.158273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0bba46d8-d479-4e6e-93a7-01939d773640 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.253577 Apr 20 18:28:46.170333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 424/845] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:45 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:47.178686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:47.179511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:47.192331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:47.192870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:47.193756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:47.194249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:47.422852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:47.430772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:47.432403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:47.433640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-874e1bf8-7a65-47b5-9576-b99d130ddc7b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1738 microversion: 2.20 time: 0.259721 Apr 20 18:28:47.434613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 422/846] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:47 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:48.453518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:48.454181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:48.462718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:48.463221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:48.464049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:48.464538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:48.679001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:48.688371 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:48.690058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:48.691335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-10a2c2c2-0d8c-468b-8f23-2b2164b10267 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1720 microversion: 2.20 time: 0.242061 Apr 20 18:28:48.692156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 425/847] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:48 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:49.711640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:49.712301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:49.720160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:49.720669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:49.721498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:49.721991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:49.929447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:49.938907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:49.940587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:49.941807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5507ee88-d3c6-487f-83b6-0c1a1e819cc2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1720 microversion: 2.20 time: 0.234323 Apr 20 18:28:49.942421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 423/848] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:49 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:50.962971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:50.963675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:50.971676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:50.972179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:50.973007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:50.973495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:51.192174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:51.201681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:51.203384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:51.204626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a84ccf84-5f8d-461f-ba01-c400110b2389 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1720 microversion: 2.20 time: 0.247441 Apr 20 18:28:51.205232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 426/849] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:50 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:51.632946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-a4f8cd69-2ba9-429b-812e-36c9b118b384 req-eaa4503f-a44c-4c1b-9b95-d77031c087de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "name": "network-vif-unplugged", "status": "completed", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:51.634686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:28:51.634686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:28:51.644568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-a4f8cd69-2ba9-429b-812e-36c9b118b384 req-eaa4503f-a44c-4c1b-9b95-d77031c087de service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:51.645063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-a4f8cd69-2ba9-429b-812e-36c9b118b384 req-eaa4503f-a44c-4c1b-9b95-d77031c087de service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:51.663166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.compute.server_external_events [req-a4f8cd69-2ba9-429b-812e-36c9b118b384 req-eaa4503f-a44c-4c1b-9b95-d77031c087de service nova] Unable to find a host for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27. Dropping event network-vif-unplugged {{(pid=100570) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 18:28:51.664366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-a4f8cd69-2ba9-429b-812e-36c9b118b384 req-eaa4503f-a44c-4c1b-9b95-d77031c087de service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036591 Apr 20 18:28:51.664992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 424/850] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:28:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 18:28:52.224670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:52.225505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:52.233556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:52.234129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:52.235060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:52.235818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:52.444314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:52.453751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:52.455475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:52.456704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-12af0ca6-14b2-40ae-9860-dc0e7a92a7a3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1663 microversion: 2.20 time: 0.236252 Apr 20 18:28:52.457323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 427/851] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:52 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1663 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:52.476954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c12b2bdd-9b4b-4190-bbf7-7044ddb9f526"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:52.478139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:52.485859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:52.486364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:52.487228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:52.487724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:52.922502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9fce2f93-be4d-4729-9b81-db9808ef8407 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.449786 Apr 20 18:28:52.923173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 425/852] 10.222.0.22 () {62 vars in 1354 bytes} [Tue Apr 20 18:28:52 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/os-volume_attachments => generated 188 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:28:53.035883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:53.036431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:53.045019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:53.045528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:53.046360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:53.046883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:53.483527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4e553536-f96e-4806-acc7-208ff483e1d8 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/os-volume_attachments/c12b2bdd-9b4b-4190-bbf7-7044ddb9f526" status: 202 len: 0 microversion: 2.20 time: 0.451714 Apr 20 18:28:53.484176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 428/853] 10.222.0.22 () {60 vars in 1447 bytes} [Tue Apr 20 18:28:53 2021] DELETE /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/os-volume_attachments/c12b2bdd-9b4b-4190-bbf7-7044ddb9f526 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:28:53.588630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:28:53.589251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:53.597190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:53.597698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:53.598555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:53.599051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:53.746238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b4ba6342-598a-4abe-a0e4-1b5828ea2187 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action" status: 202 len: 0 microversion: 2.20 time: 0.162213 Apr 20 18:28:53.746931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 426/854] 10.222.0.22 () {62 vars in 1309 bytes} [Tue Apr 20 18:28:53 2021] POST /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:28:53.755457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:53.756669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:53.764640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:53.765156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:53.766009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:53.766520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:53.981547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:53.992048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:53.993726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:53.995019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d25c7588-d3c0-4dbf-9372-be5e08e2e80b tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1671 microversion: 2.20 time: 0.243611 Apr 20 18:28:53.995624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 429/855] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:53 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1671 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:55.016219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:55.016862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:55.025871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:55.026386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:55.027261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:55.027750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:55.463280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:55.472936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:55.474681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:55.475952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6f0612bd-ecad-4b90-a1c4-3ee8c1a0a39f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1673 microversion: 2.20 time: 0.464070 Apr 20 18:28:55.476568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 427/856] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:55 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1673 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:56.495873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:56.496534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:56.504429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:56.504932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:56.505761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:56.506245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:56.732754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:56.743477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:56.745422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:56.746866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3b32af0f-5293-4230-8e6b-53c1dc4432a7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.255113 Apr 20 18:28:56.748158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 430/857] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:56 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:28:57.767468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:57.769107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:57.778683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:57.779426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:57.780496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:57.781187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:58.014313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:58.024584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:58.026295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:58.027514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-14e97ea7-3234-440c-afeb-73c32d727811 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.264372 Apr 20 18:28:58.028109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 428/858] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:57 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:28:59.049405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:28:59.050071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:28:59.058779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:59.059511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:59.060356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:28:59.060845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:28:59.289257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:59.299479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:59.301156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:28:59.302445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-21752f85-dc16-44a2-8094-4229400a9c88 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.257867 Apr 20 18:28:59.303313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 431/859] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:28:59 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:00.322309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:00.322975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:00.330882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:00.331336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:00.332172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:00.332664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:00.566041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:00.576355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:00.578039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:00.579349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-963cbaec-44d0-4add-959f-1fe3eba9bbf2 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.261801 Apr 20 18:29:00.580363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 429/860] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:00 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:01.598621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:01.599309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:01.611252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:01.611753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:01.612597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:01.613083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:02.074156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:02.084701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:02.086393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:02.087729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-051b69a6-b315-4890-9a90-d33f49b0690d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.493114 Apr 20 18:29:02.088515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 432/861] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:01 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:03.107240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:03.107888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:03.116701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:03.117322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:03.118240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:03.118828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:03.364442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:03.375694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:03.377344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:03.378715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3ead3ee4-b67b-42cf-abf1-9af6910f5a9d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.275419 Apr 20 18:29:03.379546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 430/862] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:03 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:04.400281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:04.401001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:04.408969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:04.409457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:04.410303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:04.410829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:04.645186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:04.655044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:04.656788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:04.658138 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ab9348a-55db-4e4b-aac3-3abf578912cd tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.263617 Apr 20 18:29:04.662405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 433/863] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:04 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:05.679060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:05.679740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:05.687917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:05.688434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:05.689289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:05.689789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:05.915954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:05.925839 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:05.927555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:05.929342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fff69e45-1037-4eda-83ff-70a037557772 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.254518 Apr 20 18:29:05.934733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 431/864] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:05 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:06.948482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:06.949183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:06.957012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:06.957521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:06.958353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:06.958874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:07.171558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:07.180931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:07.182631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:07.183863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-77bba10c-21ba-4587-bd56-05371b322aeb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.239542 Apr 20 18:29:07.184475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 434/865] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:06 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:08.203717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:08.204380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:08.212698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:08.213218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:08.214027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:08.214534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:08.426962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:08.436766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:08.438417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:08.439743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-836e6fc2-d9e3-4b2a-8934-e523a648f4bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.239982 Apr 20 18:29:08.440350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 432/866] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:08 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:09.460052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:09.460719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:09.468604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:09.469101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:09.469929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:09.470422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:09.685092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:09.696297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:09.697979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:09.699251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6dba5841-db45-4c0d-8f4e-b5e7dcb9af57 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.244009 Apr 20 18:29:09.699924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 435/867] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:09 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:10.718670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:10.719335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:10.727953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:10.728459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:10.729290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:10.729788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:10.941635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:10.951581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:10.953250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:10.954485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bfd03034-161e-4a95-9fdc-8b22024d5499 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.239947 Apr 20 18:29:10.955111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 433/868] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:10 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:11.789522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-9e336ce3-c22d-4681-bf94-472b8406bd42 req-86f780c2-2d99-4b16-a48f-1a98e76b54ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "name": "network-vif-plugged", "status": "completed", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:29:11.791667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:29:11.791667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:29:11.800965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9e336ce3-c22d-4681-bf94-472b8406bd42 req-86f780c2-2d99-4b16-a48f-1a98e76b54ce service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:11.801467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9e336ce3-c22d-4681-bf94-472b8406bd42 req-86f780c2-2d99-4b16-a48f-1a98e76b54ce service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:11.820002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-9e336ce3-c22d-4681-bf94-472b8406bd42 req-86f780c2-2d99-4b16-a48f-1a98e76b54ce service nova] Creating event network-vif-plugged:d04185fb-b7be-4560-98ad-57be1b019e17 for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 on hv-cinder-78693 Apr 20 18:29:11.825094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-9e336ce3-c22d-4681-bf94-472b8406bd42 req-86f780c2-2d99-4b16-a48f-1a98e76b54ce service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040370 Apr 20 18:29:11.825835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 436/869] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:29:11.973580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:11.974248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:11.983288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:11.983797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:11.984636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:11.985161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:12.283946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:12.294234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:12.295940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:12.297157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e3c0a655-f8ac-4fb5-853c-8bdbe7d0760d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.327655 Apr 20 18:29:12.297776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 434/870] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:11 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:13.317283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:13.318054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:13.326810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:13.327320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:13.328164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:13.328658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:13.552093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:13.562514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:13.564295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:13.565603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ecccf04b-7b7a-4a85-a77a-d2e7be53d274 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1729 microversion: 2.20 time: 0.252953 Apr 20 18:29:13.566326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 437/871] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:13 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1729 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:14.586605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:14.587272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:14.595160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:14.595666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:14.596493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:14.596982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:14.808434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:14.817973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:14.820170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:14.821376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-67da5e68-4679-4f91-b390-1e872ad74635 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1716 microversion: 2.20 time: 0.239576 Apr 20 18:29:14.821986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 435/872] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:14 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1716 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:38.625485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:38.626553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:38.635705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:38.636209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:38.637042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:38.637530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:38.846136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c009cb25-89e3-4520-95cb-a7072b890301 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.224766 Apr 20 18:29:38.846768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 438/873] 10.222.0.22 () {58 vars in 1292 bytes} [Tue Apr 20 18:29:38 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:39.096814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:39.097293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:39.105416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:39.105923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:39.106792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:39.107291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:39.177647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-04a9daa0-4f3d-4620-9601-65152c0f7b0e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/c2914674-af64-46c5-947a-f889d61f493b" status: 200 len: 194 microversion: 2.1 time: 0.085007 Apr 20 18:29:39.183576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 436/874] 10.222.0.22 () {58 vars in 1403 bytes} [Tue Apr 20 18:29:39 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/c2914674-af64-46c5-947a-f889d61f493b => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:39.189219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:39.189766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:39.198270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:39.198757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:39.202681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:39.203202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:39.377062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lazy-loading 'services' on Instance uuid 5fdafac6-0e5f-4d11-a71a-071aaad3f92e {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:29:39.515190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cb8f7de5-ed40-4022-b7fa-580613d94673 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/c2914674-af64-46c5-947a-f889d61f493b" status: 202 len: 0 microversion: 2.1 time: 0.329807 Apr 20 18:29:39.515871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 439/875] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:29:39 2021] DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/c2914674-af64-46c5-947a-f889d61f493b => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:29:48.035182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:48.035772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:48.043820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:48.044323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:48.045149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:48.045637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:48.109587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:29:48.221797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8aa48fa4-e344-4595-bcf7-35fbc89ff5bb tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 204 len: 0 microversion: 2.20 time: 0.190409 Apr 20 18:29:48.222486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 437/876] 10.222.0.22 () {60 vars in 1270 bytes} [Tue Apr 20 18:29:48 2021] DELETE /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:29:48.231902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:48.232664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:48.240799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:48.241817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:48.242687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:48.243180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:48.460420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:48.469665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:48.471431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:48.472639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eac61438-d579-48a1-ac3a-4260dbd43ab3 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.245350 Apr 20 18:29:48.473234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 440/877] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:48 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:49.494260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:49.495047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:49.502830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:49.503333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:49.504157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:49.504641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:49.719437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:49.728925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:49.730642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:49.731842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-34526a4f-01f4-4402-9065-f15ad72cf49d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1722 microversion: 2.20 time: 0.242833 Apr 20 18:29:49.732454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 438/878] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:49 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:50.751923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:50.752870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:50.761338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:50.761842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:50.762788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:50.763275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:50.890628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:50.901284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:50.903035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:50.904250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-99668b6f-10d4-4c42-83eb-0e4545f5c77d tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1654 microversion: 2.20 time: 0.156482 Apr 20 18:29:50.904852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 441/879] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:50 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:29:51.586374 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-cf7138a5-e70c-4724-8a68-c0b0275b9740 req-235e9f4c-2576-4b32-a7dc-1d2c4971d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fff8a35-5e92-4dae-ae33-9daba2dd0f27", "name": "network-vif-deleted", "tag": "d04185fb-b7be-4560-98ad-57be1b019e17"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:29:51.588367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:29:51.588367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:29:51.597653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-cf7138a5-e70c-4724-8a68-c0b0275b9740 req-235e9f4c-2576-4b32-a7dc-1d2c4971d8f4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:51.598493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-cf7138a5-e70c-4724-8a68-c0b0275b9740 req-235e9f4c-2576-4b32-a7dc-1d2c4971d8f4 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:51.620319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-cf7138a5-e70c-4724-8a68-c0b0275b9740 req-235e9f4c-2576-4b32-a7dc-1d2c4971d8f4 service nova] Creating event network-vif-deleted:d04185fb-b7be-4560-98ad-57be1b019e17 for instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 on hv-cinder-78693 Apr 20 18:29:51.625319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-cf7138a5-e70c-4724-8a68-c0b0275b9740 req-235e9f4c-2576-4b32-a7dc-1d2c4971d8f4 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043104 Apr 20 18:29:51.626183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 439/880] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:29:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:51.924073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:51.924803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:51.932616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:51.933122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:51.933959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:51.934452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:52.006987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:52.007438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:52.007957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lazy-loading 'fault' on Instance uuid 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:29:52.077611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:52.087897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:52.089591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24529cdaf02244a78d926691d0342d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef76467afabe40069eec102250c40fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:29:52.090850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2c71de53-da6e-4743-be24-28c50c45825f tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 200 len: 1371 microversion: 2.20 time: 0.170993 Apr 20 18:29:52.091584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 442/881] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:51 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:53.110318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:53.111023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:29:53.119771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:53.120275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:53.121105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:53.121597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:53.174688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] HTTP exception thrown: Instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 could not be found. Apr 20 18:29:53.175352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Returning 404 to user: Instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:29:53.176253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f56f690c-2ce4-44d4-91f5-b4b2b7967837 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 404 len: 111 microversion: 2.20 time: 0.070680 Apr 20 18:29:53.176857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 440/882] 10.222.0.22 () {60 vars in 1267 bytes} [Tue Apr 20 18:29:53 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:29:53.185900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d6277509-143a-4781-b6c6-6b37d4bd4cc7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '.version_select at 0x7f1a175f41e0>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:53.204506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d6277509-143a-4781-b6c6-6b37d4bd4cc7 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410904299" status: 204 len: 0 microversion: 2.20 time: 0.022593 Apr 20 18:29:53.205135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 443/883] 10.222.0.22 () {60 vars in 1249 bytes} [Tue Apr 20 18:29:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410904299 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 20 18:32:31.775524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:32:31.776042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:32:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:32:45.043703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:32:45.044234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:32:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:32:47.703976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:32:47.704544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:32:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:32:52.668745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:32:52.669217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:32:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:34:10.272556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:34:10.273023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:34:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:34:46.001968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:34:46.002441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:34:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:34:49.870035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:49.871272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:49.875446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:34:49.880998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:49.881588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:49.882536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:49.883109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:50.132068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lazy-loading 'services' on Instance uuid 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:34:50.270639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-08763758-c145-42af-933a-866083dd9939 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "DELETE /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5/os-volume_attachments/793b0677-7c16-46cb-a5e1-a59a237c0861" status: 202 len: 0 microversion: 2.1 time: 0.404535 Apr 20 18:34:50.271274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 441/884] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:34:49 2021] DELETE /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5/os-volume_attachments/793b0677-7c16-46cb-a5e1-a59a237c0861 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:35:39.172866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:39.173418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:39.176936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:35:39.182262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.182797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.183618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.184129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.506048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lazy-loading 'services' on Instance uuid 5fdafac6-0e5f-4d11-a71a-071aaad3f92e {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:39.645252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eac89386-7c0d-4880-8448-b5a3fea19282 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/916a6012-c2b7-459c-8854-797e04f5d31e" status: 202 len: 0 microversion: 2.1 time: 0.477122 Apr 20 18:35:39.645930 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 444/885] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 18:35:39 2021] DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e/os-volume_attachments/916a6012-c2b7-459c-8854-797e04f5d31e => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:35:51.794673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:35:51.795169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:35:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:35:54.725631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:54.726298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:54.735546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.736057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.736892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.737386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.777687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37662. Apr 20 18:35:54.795513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] HTTP exception thrown: Instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 could not be found. Apr 20 18:35:54.796184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Returning 404 to user: Instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:54.797355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76c0a518-de5a-4f0e-9c1a-3ea0de22b3d5 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 404 len: 111 microversion: 2.1 time: 0.086942 Apr 20 18:35:54.798057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 442/886] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:54 2021] DELETE /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:54.817943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:54.818735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 9fff8a35-5e92-4dae-ae33-9daba2dd0f27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:54.828049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.828554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.829381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.829871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.882482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37666. Apr 20 18:35:54.884045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] HTTP exception thrown: Instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 could not be found. Apr 20 18:35:54.884719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Returning 404 to user: Instance 9fff8a35-5e92-4dae-ae33-9daba2dd0f27 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:54.885629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-591991db-32e1-4070-9251-ee549d2d4d75 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27" status: 404 len: 111 microversion: 2.1 time: 0.082861 Apr 20 18:35:54.886241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 445/887] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:54 2021] GET /compute/v2.1/servers/9fff8a35-5e92-4dae-ae33-9daba2dd0f27 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:36:07.721456 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:36:07.721955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:36:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:36:12.685686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:36:12.686189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:36:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:37:30.289192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:37:30.289710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:37:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:38:06.019144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:38:06.019628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:38:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:39:11.812512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:39:11.813010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:39:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:39:27.738309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:39:27.738931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:39:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:39:32.702740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:39:32.703202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:39:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:40:50.306614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:40:50.307167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:40:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:40:50.978641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:50.979201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:50.982773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:40:50.988948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.989503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.990310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.990846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:51.054809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:40:51.151735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [685f76d6-b45b-4ad2-95f6-798268f829d3] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 18:40:52.000190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39358. Apr 20 18:40:52.166633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [685f76d6-b45b-4ad2-95f6-798268f829d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39360. Apr 20 18:40:52.187340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-54cac8a1-cd1b-4a81-8cf8-260ef50eb05a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "DELETE /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 204 len: 0 microversion: 2.1 time: 1.213179 Apr 20 18:40:52.188176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 443/888] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:40:50 2021] DELETE /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:40:52.197797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:52.198489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:52.202011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:40:52.208025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.208531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.209367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.209860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.565744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:52.575689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b7a51d1a-5b17-4b71-a9be-69afde8434c5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1561 microversion: 2.1 time: 0.382482 Apr 20 18:40:52.576492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 446/889] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:52 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1561 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:53.597151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:53.597849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:53.606215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:53.606762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:53.607650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:53.608155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:54.059372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:54.069693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a6b76990-639c-45e1-b267-03981ac1f030 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1519 microversion: 2.1 time: 0.477805 Apr 20 18:40:54.081681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 444/890] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:53 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1519 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:54.099216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39390. Apr 20 18:40:54.136401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-e20852b6-90d3-418b-88fb-cffd0ad5f45e req-3b8641da-bac9-4c4d-ae7e-e2a4dfcd5c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4ed2e4-f7d1-4c76-a041-11247df1d6a5", "name": "network-vif-deleted", "tag": "9b8638c7-2dd4-44d0-8bb4-6c5f9e1c4bcc"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:54.138191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:54.138191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:40:54.147817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-e20852b6-90d3-418b-88fb-cffd0ad5f45e req-3b8641da-bac9-4c4d-ae7e-e2a4dfcd5c4c service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:54.148324 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-e20852b6-90d3-418b-88fb-cffd0ad5f45e req-3b8641da-bac9-4c4d-ae7e-e2a4dfcd5c4c service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:54.165957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-e20852b6-90d3-418b-88fb-cffd0ad5f45e req-3b8641da-bac9-4c4d-ae7e-e2a4dfcd5c4c service nova] Creating event network-vif-deleted:9b8638c7-2dd4-44d0-8bb4-6c5f9e1c4bcc for instance 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 on hv-cinder-78693 Apr 20 18:40:54.172394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-e20852b6-90d3-418b-88fb-cffd0ad5f45e req-3b8641da-bac9-4c4d-ae7e-e2a4dfcd5c4c service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102135 Apr 20 18:40:54.173040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 447/891] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:40:55.088816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:55.089526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:55.098033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:55.098557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:55.099382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:55.099873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:55.237620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:55.246984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f38c324-5168-47d9-8765-ee8ebd98571b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.162220 Apr 20 18:40:55.247600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 445/892] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:55 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:56.265887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:56.266679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:56.274689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:56.275201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:56.276036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:56.276530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:56.399677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:56.409017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f6168fba-9a20-4245-9369-acbb3661767c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147832 Apr 20 18:40:56.409632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 448/893] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:56 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:57.427106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:57.427775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:57.435827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:57.436338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:57.437157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:57.437645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:57.558668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:57.568503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e605d6dc-0c2f-4193-bd0c-bfef73ba9842 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145445 Apr 20 18:40:57.569112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 446/894] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:57 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:40:58.586412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:58.587104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:58.594906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:58.595414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:58.596277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:58.596771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:58.719796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:58.729241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4f7e5576-9ac3-4557-a97e-2a05f6f8f087 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146831 Apr 20 18:40:58.729900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 449/895] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:58 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:59.747423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:59.748135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:59.756522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:59.757032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:59.757871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:59.758366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:59.885439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:59.895471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-23490f58-27c6-414d-98de-1078cf39dd0e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152158 Apr 20 18:40:59.896086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 447/896] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:59 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:00.914524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:00.915112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:00.923058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:00.923568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:00.924412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:00.924909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:01.052112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:01.061650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8378e525-437f-4ab7-b3ab-1f8534c17037 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151412 Apr 20 18:41:01.062267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 450/897] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:00 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:02.080762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:02.081369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:02.089244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:02.089747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:02.090586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:02.091075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:02.212450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:02.221863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76eb56bd-942e-4b9b-8ae3-e6416fd69265 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145849 Apr 20 18:41:02.222496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 448/898] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:02 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:03.240191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:03.240850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:03.248784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:03.249265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:03.250086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:03.250604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:03.372719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:03.383168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-348be5df-dda7-427f-aceb-9e89d8531679 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147127 Apr 20 18:41:03.383792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 451/899] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:03 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:04.402129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:04.402838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:04.410874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:04.411387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:04.412223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:04.412722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:04.535163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:04.544891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8d79edc5-363a-49ac-ab32-9693590d4e42 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146842 Apr 20 18:41:04.545518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 449/900] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:04 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:05.563497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:05.564196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:05.572085 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:05.572577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:05.573399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:05.573884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:05.697560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:05.707423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c1ea9ba9-7ee1-4b6f-a5e9-d6f5128216cf tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148034 Apr 20 18:41:05.708284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 452/901] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:05 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:06.726499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:06.727149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:06.735107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:06.735621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:06.736454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:06.736948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:06.865641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:06.874970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8d4c294c-b1c3-4741-8f12-036a90ed83f6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152539 Apr 20 18:41:06.875591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 450/902] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:06 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:07.893296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:07.894006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:07.901842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:07.902345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:07.903206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:07.903695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:08.031921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:08.041993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8abfe8bd-4851-4d8c-9cfe-6c71a27cc8a0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152821 Apr 20 18:41:08.042635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 453/903] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:07 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:09.067557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:09.068170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:09.076014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:09.076520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:09.077352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:09.077849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:09.201458 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:09.211365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2453458b-0b72-4d31-bafe-10a1861373e3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147942 Apr 20 18:41:09.211970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 451/904] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:09 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:10.229218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:10.229893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:10.238679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:10.239185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:10.240028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:10.240521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:10.364304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:10.373656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1c574d86-41a0-4411-a8f5-4af41d1682bb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148398 Apr 20 18:41:10.374282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 454/905] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:10 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:11.391851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:11.392539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:11.400444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:11.400946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:11.401770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:11.402257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:11.524238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:11.534050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b32f79fc-fc55-4d2f-be89-60c891237ff0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146269 Apr 20 18:41:11.534678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 452/906] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:11 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:12.553123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:12.553802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:12.561902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:12.562412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:12.563300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:12.563794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:12.688058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:12.697580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e9980574-e343-4387-9e2d-10b351fbd260 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149195 Apr 20 18:41:12.698204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 455/907] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:12 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:13.716124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:13.716794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:13.724636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:13.725151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:13.725984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:13.726490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:13.855093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:13.865091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3a98198b-5fbc-4148-9c8e-214ee68d5293 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152978 Apr 20 18:41:13.865695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 453/908] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:13 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:14.883204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:14.883785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:14.891580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:14.892080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:14.893409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:14.893892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:15.022696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:15.032612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e817786a-cb9b-4a7d-8fe2-cb5d5cdb6f19 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.153510 Apr 20 18:41:15.033849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 456/909] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:14 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:16.052154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:16.052852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:16.061081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:16.061584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:16.062417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:16.062932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:16.187428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:16.196790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5954689a-9e8a-4610-b059-485773e6271a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149349 Apr 20 18:41:16.197414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 454/910] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:16 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:17.214941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:17.215653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:17.223786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:17.224299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:17.225224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:17.225590 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:17.348665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:17.363440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c1d46141-9162-4ff0-83e0-7e1cf7a5667a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152491 Apr 20 18:41:17.364073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 457/911] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:17 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:18.382054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:18.382781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:18.390550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:18.391066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:18.391892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:18.392385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:18.513574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:18.523699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6a76b1c9-ccf3-461c-bc48-60ced79a1a0f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146283 Apr 20 18:41:18.524308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 455/912] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:18 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:19.541777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:19.542514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:19.550359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:19.550918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:19.551749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:19.552242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:19.675294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:19.684926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c60383c7-022b-49eb-b059-1246a983b759 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147262 Apr 20 18:41:19.685546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 458/913] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:19 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:20.703437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:20.704110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:20.712689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:20.713144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:20.713977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:20.714494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:20.843023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:20.852481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f3c193cd-54b7-49a3-9a13-67a0abd0390e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.153077 Apr 20 18:41:20.853093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 456/914] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:20 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:21.871292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:21.871958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:21.879908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:21.880408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:21.881241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:21.881729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:22.010229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:22.020386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-de5cf072-5356-4c00-8e5e-d084e0e44fa1 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.153195 Apr 20 18:41:22.021002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 459/915] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:21 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:23.039384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:23.040040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:23.047771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:23.048277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:23.049093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:23.049582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:23.308489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:23.317651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e4725ea2-a1b5-4a96-9c47-4d5dc85a834c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.282274 Apr 20 18:41:23.318254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 457/916] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:23 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:24.336424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:24.337089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:24.345553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:24.346057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:24.346911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:24.347391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:24.474234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:24.483629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b868aa1-6b12-458a-a9d8-5f4eecde5ada tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151306 Apr 20 18:41:24.484244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 460/917] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:24 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:25.501786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:25.502485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:25.510397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:25.510940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:25.511770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:25.512264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:25.636137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:25.646147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-188c7807-d2d5-4929-bfab-80fbf8da0264 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148526 Apr 20 18:41:25.646781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 458/918] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:25 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:26.664687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:26.665355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:26.673317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:26.673820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:26.675278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:26.675770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:26.799295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:26.810109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-367c6614-f46f-4af4-bafd-b7932160851a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149463 Apr 20 18:41:26.810766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 461/919] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:26 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:27.827728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:27.828419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:27.836365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:27.836885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:27.837724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:27.838222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:27.964492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:27.973902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bb88c398-f1a9-4cd2-b569-eeb0fa5b83e4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150200 Apr 20 18:41:27.974552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 459/920] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:27 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:28.992620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:28.993289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:29.001146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:29.001656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:29.002514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:29.003016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:29.130760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:29.140358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fa770482-7a3e-45a1-8416-b551b62f810d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151790 Apr 20 18:41:29.140957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 462/921] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:28 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:30.158265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:30.159516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:30.167412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:30.167916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:30.168748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:30.169236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:30.290397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:30.299713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4869682a-2573-40af-ad33-6335d010a21f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145516 Apr 20 18:41:30.300320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 460/922] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:30 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:31.318077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:31.318769 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:31.326602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:31.327106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:31.327937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:31.328426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:31.453729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:31.463091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-28a14ba1-b64b-45d1-a78f-d324adc5d6b3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149087 Apr 20 18:41:31.463704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 463/923] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:31 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:32.481520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:32.482191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:32.490025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:32.490565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:32.491397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:32.491887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:32.614087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:32.623629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-81d8abbd-8727-435e-8a4e-df65d516c4bd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146370 Apr 20 18:41:32.624248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 461/924] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:32 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:33.642708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:33.643899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:33.652072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:33.652580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:33.653411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:33.653896 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:33.780193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:33.791216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f865988-f64c-49c6-8251-b03c1ee4cdea tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152821 Apr 20 18:41:33.791841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 464/925] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:33 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:34.809585 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:34.810254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:34.818417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:34.818957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:34.819793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:34.820298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:34.948768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:34.958274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5562698e-ecdb-4f7a-a12c-33acadf0b69b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152949 Apr 20 18:41:34.958912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 462/926] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:34 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:35.976793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:35.977484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:35.985523 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:35.986036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:35.987012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:35.987877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:36.116880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:36.126548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e1edcd3d-aa80-4e10-8cfe-06698038d616 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.153776 Apr 20 18:41:36.127179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 465/927] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:35 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:37.144298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:37.144973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:37.153348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:37.153863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:37.154732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:37.155231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:37.279401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:37.289332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91e1a252-6645-43d2-97c4-3b2f1b77232c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149085 Apr 20 18:41:37.289940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 463/928] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:37 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:38.307659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:38.308326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:38.316148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:38.316658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:38.317492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:38.317982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:38.440452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:38.449654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8aa4f264-8d70-4469-baad-94fde0106d2b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147088 Apr 20 18:41:38.450273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 466/929] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:38 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:39.468347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:39.469021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:39.477005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:39.477520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:39.478356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:39.478899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:39.601338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:39.610778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-51e7e223-f5a4-4b10-ac90-fdcf328c15ba tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146459 Apr 20 18:41:39.611334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 464/930] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:39 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:40.628932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:40.629591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:40.637489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:40.637990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:40.638845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:40.639329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:40.764268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:40.774258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7fad7f26-73db-425f-ab20-358edd66027d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149365 Apr 20 18:41:40.774914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 467/931] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:40 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:41.792993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:41.793774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:41.801799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:41.802305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:41.804137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:41.804249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:41.932173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:41.941315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2ffd994e-a4c9-4096-b979-62d56bbad69c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152477 Apr 20 18:41:41.941925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 465/932] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:41 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:42.959869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:42.960474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:42.968555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:42.969058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:42.969881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:42.970363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:43.099434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:43.109687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b3361046-ede1-4bdb-a644-7b05896a43eb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.154296 Apr 20 18:41:43.110310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 468/933] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:42 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:44.127983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:44.128653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:44.136545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:44.137054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:44.137882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:44.138372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:44.264482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:44.274570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbd69666-586a-48a1-89de-d168a237683f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150584 Apr 20 18:41:44.275184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 466/934] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:44 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:45.293075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:45.293743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:45.301616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:45.302118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:45.302962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:45.303449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:45.427500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:45.437740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7c427fb3-accb-49ad-bb98-8e32d96e73f5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149235 Apr 20 18:41:45.438356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 469/935] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:45 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:46.455981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:46.456656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:46.464476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:46.464974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:46.465802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:46.466285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:46.587248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:46.596677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ae00ec8b-866f-4905-8b48-c20be6a886c7 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.144695 Apr 20 18:41:46.597291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 467/936] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:46 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:47.614821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:47.615491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:47.623328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:47.623830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:47.624660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:47.625152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:47.748135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:47.757516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f1f1cf80-314e-46d1-8795-5f40eb3f5439 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146798 Apr 20 18:41:47.762520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 470/937] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:47 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:41:48.777526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:48.778250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:48.786233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:48.786798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:48.787630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:48.788121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:48.916348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:48.925619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8a37741d-9e90-49cd-aa3d-ba7ca21f3cb5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152680 Apr 20 18:41:48.926230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 468/938] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:48 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:49.944236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:49.945053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:49.953500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:49.954002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:49.954909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:49.955405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:50.083003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:50.092395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4a233dc8-58d9-4aa3-92b4-af0df3c5a416 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152394 Apr 20 18:41:50.093017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 471/939] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:49 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:51.110345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:51.110835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:51.118749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:51.119251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:51.120081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:51.120572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:51.242184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:51.251509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d3f69169-025c-4093-86e6-90f9373596ec tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145453 Apr 20 18:41:51.252130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 469/940] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:51 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:52.270056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:52.270762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:52.278693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:52.279199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:52.280032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:52.280520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:52.403120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:52.412498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f2f7d023-8e46-47d4-881a-14ef87b5a21c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146477 Apr 20 18:41:52.413109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 472/941] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:52 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:53.431841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:53.432512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:53.440404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:53.440907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:53.441725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:53.442214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:53.563260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:53.573018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eac7ea3c-d7d6-47c9-a610-06ab403a9dfb tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145651 Apr 20 18:41:53.573633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 470/942] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:53 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:54.136673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:54.137225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:54.145069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.145605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.146423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.146946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.206563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] HTTP exception thrown: Instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 could not be found. Apr 20 18:41:54.207295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Returning 404 to user: Instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:41:54.208944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7504c34f-e662-4416-acb1-a41ccb690879 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "DELETE /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 404 len: 111 microversion: 2.1 time: 0.076768 Apr 20 18:41:54.210064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 473/943] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:41:54 2021] DELETE /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:41:54.218844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:54.219505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] [instance: 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:54.227455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.227955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.229330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.229820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.286982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] HTTP exception thrown: Instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 could not be found. Apr 20 18:41:54.287635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] Returning 404 to user: Instance 2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:41:54.288646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d7451737-3f10-469e-90cc-9448d5cc4880 tempest-AttachVolumeShelveTestJSON-798521607 tempest-AttachVolumeShelveTestJSON-798521607-project] 10.222.0.22 "GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27" status: 404 len: 111 microversion: 2.1 time: 0.074092 Apr 20 18:41:54.289304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 471/944] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:54 2021] GET /compute/v2.1/servers/2fc4c27f-cb54-4e90-b5c7-e29aaa58fd27 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:41:54.591731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:54.592443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:54.600261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.600775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.601606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.602096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.727995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:54.738066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ce1e4687-f309-4705-87b1-d8c05d08d360 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150971 Apr 20 18:41:54.738745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 474/945] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:54 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:55.755986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:55.756628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:55.765200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:55.765718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:55.767476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:55.767476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:55.939993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:55.950183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-aea4df60-9bfa-47fd-a176-d1390072e0a5 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.198122 Apr 20 18:41:55.961046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 472/946] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:55 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:56.969325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:56.970017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:56.977973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:56.978492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:56.979355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:56.980395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:57.110854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:57.140826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-96888394-9b58-4a92-8117-0f2aa5db0163 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.175704 Apr 20 18:41:57.142377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 475/947] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:56 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:58.160736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:58.161401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:58.169837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:58.170344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:58.171200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:58.171698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:58.338982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:58.349460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e2ff5610-f808-4e28-bd3b-7cf224825ef3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.192844 Apr 20 18:41:58.350205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 473/948] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:58 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:59.370990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:59.372989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:59.381965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:59.382997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:59.383929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:59.384631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:59.515945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:59.527148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8ab6f46a-2282-4e5a-9973-084e3ff4d695 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.161033 Apr 20 18:41:59.527785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 476/949] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:59 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:00.545540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:00.546139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:00.554070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:00.554637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:00.555479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:00.555966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:00.693941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:00.703445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2c990878-d502-4920-be37-4b499ef7e576 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.162070 Apr 20 18:42:00.704059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 474/950] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:00 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:01.721430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:01.722105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:01.730647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:01.731162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:01.732004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:01.732502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:01.860224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:01.869748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-919801a3-ce34-4245-8eb9-0cc624979d3b tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152358 Apr 20 18:42:01.871011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 477/951] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:01 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:02.889648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:02.890320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:02.898206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:02.898752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:02.899588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:02.900087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:03.025675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:03.035149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7c14c4a4-e680-41ff-a777-bb57f8e86ad0 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150149 Apr 20 18:42:03.035773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 475/952] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:02 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:04.053636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:04.054244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:04.062347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:04.062910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:04.063745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:04.064244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:04.189431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:04.199360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b6eb4d03-4412-4a7e-8dcc-a433cb380874 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149966 Apr 20 18:42:04.199980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 478/953] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:04 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:05.217959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:05.218664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:05.226441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:05.226967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:05.227791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:05.228281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:05.351103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:05.361223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3218ca6c-d626-43b3-a556-463a61eea58a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147839 Apr 20 18:42:05.361841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 476/954] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:05 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:06.379467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:06.380131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:06.388549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:06.389049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:06.389871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:06.390358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:06.513209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:06.522548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d9045555-721e-458d-911b-a4015096252c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147066 Apr 20 18:42:06.523139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 479/955] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:06 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:07.540627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:07.541290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:07.549327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:07.549831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:07.550905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:07.551171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:07.678927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:07.689293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fc4ef580-d0ce-42f6-9555-7b0862e4d421 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152729 Apr 20 18:42:07.689910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 477/956] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:07 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:08.908726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:08.909392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:08.917140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:08.917643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:08.918481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:08.918973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:09.043624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:09.053018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a689b4a3-d30e-4d11-b1af-bd3da73d4827 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.349368 Apr 20 18:42:09.053620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 480/957] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:08 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:10.072070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:10.072702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:10.081056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:10.081563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:10.082397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:10.082924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:10.207322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:10.217202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-775284ce-0c90-4a91-acad-67e14be23cac tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149251 Apr 20 18:42:10.217815 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 478/958] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:10 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:11.235908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:11.236623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:11.244420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:11.244975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:11.245810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:11.246294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:11.371693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:11.380946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ce34f20-490b-4eef-b47a-148861e0d826 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149158 Apr 20 18:42:11.381557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 481/959] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:11 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:12.399459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:12.400096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:12.408146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:12.408648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:12.409467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:12.409952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:12.531329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:12.540491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-681c03d2-313f-44d9-b807-245652937e98 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145171 Apr 20 18:42:12.541103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 479/960] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:12 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:13.559910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:13.560595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:13.568459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:13.568969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:13.569807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:13.570302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:13.692706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:13.702493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6232b973-546a-4a13-bad7-b42421782354 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147350 Apr 20 18:42:13.703212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 482/961] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:13 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:14.721436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:14.722042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:14.729880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:14.730393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:14.731277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:14.731771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:14.860178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:14.869675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c43a4ae4-4cb8-4b74-a09b-d5bd43826c1c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152400 Apr 20 18:42:14.870832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 480/962] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:14 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:15.888345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:15.889017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:15.896772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:15.897270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:15.898096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:15.898611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:16.024100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:16.033263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d34f0a22-1a16-484a-8748-d2bdea3e8fef tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149010 Apr 20 18:42:16.033876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 483/963] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:15 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:17.052667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:17.053389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:17.061975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:17.062502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:17.063349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:17.063849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:17.191224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:17.201176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5eddded5-14e3-40c9-9a32-11e3f6fb5605 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.152703 Apr 20 18:42:17.201800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 481/964] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:17 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:18.219712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:18.220420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:18.228182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:18.228687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:18.229522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:18.230011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:18.356613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:18.366090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7b4c85c1-6622-4e00-ada2-0e839a43edde tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150373 Apr 20 18:42:18.366730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 484/965] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:18 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:19.383939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:19.384586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:19.392406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:19.392906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:19.393731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:19.394243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:19.515230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:19.524386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-196e1272-8799-4c02-a038-edee1242639a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.144560 Apr 20 18:42:19.524996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 482/966] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:19 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:20.543540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:20.544150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:20.552132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:20.552643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:20.553481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:20.553977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:20.675871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:20.685949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-44929571-0f45-4201-ad2c-a8d25fb1fdd9 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147123 Apr 20 18:42:20.686607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 485/967] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:20 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:21.704059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:21.704675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:21.712558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:21.713064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:21.713888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:21.714383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:21.839176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:21.849079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d521d83-925f-49e8-b03f-456c7bf74d2a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149149 Apr 20 18:42:21.849692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 483/968] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:21 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:22.867612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:22.868272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:22.876624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:22.877120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:22.877937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:22.878421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:23.001910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:23.011140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbd19bb0-873f-4ac7-b7ee-c1be69d70cc4 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147597 Apr 20 18:42:23.011788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 486/969] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:22 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:24.029619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:24.030323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:24.038112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:24.038648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:24.039471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:24.039954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:24.169543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:24.178881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d0352eef-1665-4db9-86d0-c537fed1bb16 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.153328 Apr 20 18:42:24.179499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 484/970] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:24 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:25.198176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:25.199369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:25.207198 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:25.207742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:25.208577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:25.209070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:25.335243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:25.345253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c44e025a-74b5-497b-97aa-c103703c0e51 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151181 Apr 20 18:42:25.345871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 487/971] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:25 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:26.363558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:26.364229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:26.372098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:26.372607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:26.373439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:26.373933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:26.501937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:26.511842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-85eb989a-6e4d-47e0-8322-8b90ef60d547 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151883 Apr 20 18:42:26.512466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 485/972] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:26 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:27.530021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:27.530721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:27.538420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:27.538949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:27.539774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:27.540258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:27.662119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:27.671448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-23fe0dfe-f817-46c6-8b55-587fda7a89df tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145715 Apr 20 18:42:27.672058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 488/973] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:27 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:28.689459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:28.690167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:28.698046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:28.698576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:28.699900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:28.700388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:28.825986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:28.835429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a8ccc07a-5dbe-4ad3-97bf-5e78768db323 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150073 Apr 20 18:42:28.836041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 486/974] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:28 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:29.854005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:29.854711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:29.863186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:29.863692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:29.864571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:29.865065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:29.988903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:29.998219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbee5667-ff6b-4bf8-965b-22777ca42c5d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148240 Apr 20 18:42:29.998871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 489/975] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:29 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:31.016798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:31.017405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:31.025206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:31.025742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:31.026586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:31.027074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:31.151250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:31.160722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f9d8b45b-df6a-4e90-8c1f-767e08846bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148068 Apr 20 18:42:31.161336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 487/976] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:31 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:31.829436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:42:31.829627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:42:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:42:32.179421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:32.180027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:32.188672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:32.189178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:32.190015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:32.190527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:32.316280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:32.326183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-385872d0-97c1-45cf-b1ec-daaa7a36f902 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150890 Apr 20 18:42:32.326852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 490/977] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:32 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:33.345359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:33.346030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:33.353857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:33.354363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:33.355545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:33.356033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:33.477938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:33.487545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3e5480ac-10ea-431d-bb3a-879991196da6 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.146474 Apr 20 18:42:33.487895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 488/978] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:33 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:34.505983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:34.506728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:34.514607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:34.515121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:34.515982 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:34.516463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:34.640231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:34.649541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fbdc5774-2e79-401a-b64a-3efc8156c08d tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147657 Apr 20 18:42:34.650161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 491/979] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:34 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:35.668416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:35.669091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:35.676969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:35.677472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:35.678301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:35.678822 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:35.805716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:35.816016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c2262650-ac15-4672-86d3-db7eb4495b80 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151656 Apr 20 18:42:35.816765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 489/980] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:35 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:36.834888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:36.835553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:36.844131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:36.844637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:36.845574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:36.845931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:36.971499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:36.981780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8c05d5b0-a3c8-45c4-9482-fa6ec9556d5e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150786 Apr 20 18:42:36.982475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 492/981] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:36 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:37.999968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:38.000633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:38.008546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:38.009043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:38.009864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:38.010348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:38.134203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:38.143526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e7d155ce-49b0-44b8-a022-327e9901512f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147594 Apr 20 18:42:38.144140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 490/982] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:37 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:39.161925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:39.162691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:39.171010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:39.171512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:39.172342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:39.172837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:39.296942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:39.306229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-302db2fe-0277-49ef-af62-36a77d877017 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148277 Apr 20 18:42:39.306874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 493/983] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:39 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:40.325260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:40.325925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:40.333773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:40.334272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:40.335118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:40.335608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:40.463345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:40.473124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9227c10d-36b2-4bc3-aabe-22af518de54a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151974 Apr 20 18:42:40.473746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 491/984] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:40 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:41.492060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:41.492729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:41.500631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:41.501132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:41.501964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:41.502503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:41.624531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:41.633779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-82d604b3-c018-4093-b9b1-da7c2df65c44 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.145851 Apr 20 18:42:41.634394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 494/985] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:41 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:42.652921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:42.653525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:42.661414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:42.661924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:42.662783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:42.663280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:42.787291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:42.797494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f9b7b87-5522-4315-ab0c-9a49b4d78e61 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149147 Apr 20 18:42:42.798125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 492/986] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:42 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:43.816126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:43.816792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:43.824661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:43.825157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:43.825972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:43.826454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:43.950436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:43.960250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1cd8412c-7968-4a7f-8f51-2297e1616848 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.148314 Apr 20 18:42:43.960872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 495/987] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:43 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:44.979397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:44.980070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:44.987919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:44.988429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:44.989260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:44.989754 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:45.116964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:45.127029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6e2757a5-8539-47a2-8c8e-1ca842188b8a tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.151717 Apr 20 18:42:45.127646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 493/988] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:44 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:46.145214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:46.145678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:46.153549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:46.154059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:46.154947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:46.155438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:46.281813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:46.291074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c0226077-6b05-47ca-a5fd-028069b91bcd tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.150089 Apr 20 18:42:46.291695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 496/989] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:46 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:47.310599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:47.311280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:47.319245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:47.319758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:47.320596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:47.321100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:47.443615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:47.452929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1cddaeb3-1add-46b9-9835-99b30ff54177 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.147178 Apr 20 18:42:47.453551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 494/990] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:47 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:47.755664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:42:47.755892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:42:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:42:48.471460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:48.472129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:48.480021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:48.480526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:48.481352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:48.481837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:48.603125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:48.612315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-887b4eb3-dde9-4747-a693-f25211529807 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.144828 Apr 20 18:42:48.612933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 497/991] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:48 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:49.629795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:49.630516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:49.638988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:49.639443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:49.640271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:49.640768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:49.765829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:49.775230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2ba22180-a1e9-449d-8623-4a629343e34e tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149446 Apr 20 18:42:49.775850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 495/992] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:49 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:50.793875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:50.794482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:50.802331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:50.802880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:50.803717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:50.804203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:50.928490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:50.938147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b58372b7-c17c-4881-8ac7-26d7b67fe91c tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.149059 Apr 20 18:42:50.938838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 498/993] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:50 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:51.955423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:51.956094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:51.963855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:51.964357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:51.965185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:51.965676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:52.086056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:52.095327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-194f1990-955e-4144-8d6e-edb48ef22eee tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.143946 Apr 20 18:42:52.095941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 496/994] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:51 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:52.721047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:42:52.721191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:42:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:42:53.113942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:53.114639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:53.122923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:53.123427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:53.124256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:53.124745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:53.386377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:53.395572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fee3a358-d57c-478a-b3d6-f2f9743056a3 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1350 microversion: 2.1 time: 0.285768 Apr 20 18:42:53.396185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 499/995] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:53 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1350 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:54.413674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:54.414336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:54.422128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:54.422663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:54.423485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:54.423972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:54.495280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:54.495702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:54.496737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lazy-loading 'fault' on Instance uuid 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:42:54.563415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a457d841519493cbd55b66075d311e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1075f749f50d4350a332442d30431fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:54.573020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-44d23026-7d45-46e0-86a8-504921b2cd9f tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 200 len: 1444 microversion: 2.1 time: 0.163370 Apr 20 18:42:54.573646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 497/996] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:54 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:55.592825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:55.593485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] [instance: 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:55.601406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:55.601907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:55.602785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:55.603264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:55.655600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] HTTP exception thrown: Instance 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 could not be found. Apr 20 18:42:55.656254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] Returning 404 to user: Instance 2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:42:55.657150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b23ce99d-96e4-41eb-85cc-9003eee88cb2 tempest-VolumesSnapshotTestJSON-2084393449 tempest-VolumesSnapshotTestJSON-2084393449-project] 10.222.0.22 "GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5" status: 404 len: 111 microversion: 2.1 time: 0.068980 Apr 20 18:42:55.657737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 500/997] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:55 2021] GET /compute/v2.1/servers/2e4ed2e4-f7d1-4c76-a041-11247df1d6a5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:43:06.038171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:43:06.038813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:43:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:44:10.323172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:44:10.323699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:44:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:45:51.846429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:45:51.846929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:45:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:46:05.070764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:46:05.071291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:46:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:46:07.781794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:46:07.782307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:46:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:46:12.739104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:46:12.739563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:46:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:46:26.055540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:46:26.056052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:46:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:47:30.339564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:47:30.340007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:47:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:47:40.045140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:47:40.048780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:40.049357 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:40.058262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:40.058758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:40.059599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:40.060104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:40.127235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:47:40.247839 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-549d1ca3-45d0-42bf-b6d7-b154abf9d4b1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 204 len: 0 microversion: 2.1 time: 0.203566 Apr 20 18:47:40.248503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 498/998] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 18:47:40 2021] DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:47:40.257278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:40.257943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:40.262362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:47:40.267788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:40.268274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:40.269237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:40.269555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:40.562313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:40.572628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1bd6939a-1411-43bf-8d6a-320fc9feb8d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1768 microversion: 2.1 time: 0.319550 Apr 20 18:47:40.573338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 501/999] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:40 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1768 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:41.591868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:41.592566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:41.612149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:41.612913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:41.613776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:41.614273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:41.653542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41760. Apr 20 18:47:42.418235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:42.428678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c7a756cf-f69f-47f3-ada6-5a8addb69143 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1768 microversion: 2.1 time: 0.841396 Apr 20 18:47:42.429560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 499/1000] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:41 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1768 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:43.109605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41772. Apr 20 18:47:43.155113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-b2ee1e62-53d7-4338-895a-6c48a969f5ac req-c1749b52-1f98-437c-8166-b9de8443e3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdafac6-0e5f-4d11-a71a-071aaad3f92e", "name": "network-vif-deleted", "tag": "eb43c1e2-ebae-4195-ac80-55e62d766ee3"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:43.156880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:47:43.156880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 18:47:43.166210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b2ee1e62-53d7-4338-895a-6c48a969f5ac req-c1749b52-1f98-437c-8166-b9de8443e3ce service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:43.166912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b2ee1e62-53d7-4338-895a-6c48a969f5ac req-c1749b52-1f98-437c-8166-b9de8443e3ce service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:43.185296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-b2ee1e62-53d7-4338-895a-6c48a969f5ac req-c1749b52-1f98-437c-8166-b9de8443e3ce service nova] Creating event network-vif-deleted:eb43c1e2-ebae-4195-ac80-55e62d766ee3 for instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e on hv-cinder-78693 Apr 20 18:47:43.192499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-b2ee1e62-53d7-4338-895a-6c48a969f5ac req-c1749b52-1f98-437c-8166-b9de8443e3ce service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103982 Apr 20 18:47:43.192773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 502/1001] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 18:47:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:43.448421 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:43.449091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:43.458668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:43.459209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:43.460035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:43.460521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:43.601275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:43.612265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-847fe94c-6f21-40c4-b5bd-aabd3a3bc5ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.168239 Apr 20 18:47:43.612895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 500/1002] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:43 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:44.631832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:44.633164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:44.641478 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:44.642001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:44.642858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:44.643351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:44.985332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:44.995507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c9f709da-ca9c-4379-9d16-3943374a8460 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.368559 Apr 20 18:47:44.996115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 503/1003] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:44 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:46.017481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:46.018155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:46.026036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:46.026598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:46.027970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:46.028465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:46.161083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:46.175554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-236c15c2-fc02-4dcf-8b4d-0604f4b64d56 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161917 Apr 20 18:47:46.176195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 501/1004] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:46 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:47.194575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:47.196619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:47.203844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:47.204353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:47.205207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:47.205699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:47.331753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:47.342777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7398426c-26a6-4515-8f88-ccb50683a028 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152812 Apr 20 18:47:47.343411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 504/1005] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:47 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:48.361308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:48.361981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:48.370076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:48.370599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:48.371442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:48.371940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:48.498681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:48.508783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-02496edb-ae00-4a45-b792-71f5d4620988 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152196 Apr 20 18:47:48.509408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 502/1006] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:48 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:49.527508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:49.528225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:49.537915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:49.538565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:49.539464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:49.539958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:49.680362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:49.692222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d6db21ce-5a5a-40ae-92f9-12719bc5ad59 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.168901 Apr 20 18:47:49.692846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 505/1007] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:49 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:50.711261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:50.711852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:50.720394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:50.720897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:50.721726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:50.722216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:50.847393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:50.857350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6591ddb9-1728-4897-9161-475bd1276a92 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150333 Apr 20 18:47:50.857977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 503/1008] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:50 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:51.875440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:51.876102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:51.884274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:51.884777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:51.885610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:51.886098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:52.010837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:52.020797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3179c5d6-335e-4096-9fa3-fa9dbd1c4ecc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.149422 Apr 20 18:47:52.021417 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 506/1009] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:51 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:53.125945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:53.126638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:53.134529 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:53.135035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:53.135851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:53.136336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:53.269438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:53.279967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1494da46-4eea-44c9-be78-2f2a7d8f11b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.244586 Apr 20 18:47:53.281088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 504/1010] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:53 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:54.299199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:54.299868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:54.307722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:54.308229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:54.309058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:54.309551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:54.431742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:54.442404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-88972725-5f06-4c72-988e-85dc082e6321 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.147909 Apr 20 18:47:54.443054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 507/1011] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:54 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:55.460753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:55.461413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:55.469323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:55.469827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:55.470681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:55.471173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:55.593652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:55.603498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-01c0328b-a407-421a-b9f8-2dac7946465a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.146932 Apr 20 18:47:55.604113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 505/1012] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:55 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:56.622172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:56.622881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:56.633406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:56.633940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:56.634784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:56.635284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:56.761576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:56.773538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5f6914a7-cf9b-4c46-955c-5506db69c3dd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155445 Apr 20 18:47:56.774419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 508/1013] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:56 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:57.792391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:57.793091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:57.801191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:57.801695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:57.802560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:57.803060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:57.930782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:57.941339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ef91e15-3788-4899-b7be-481b3441e6bd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152771 Apr 20 18:47:57.942062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 506/1014] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:57 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:58.963062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:47:58.963750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:47:58.973864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:58.974498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:58.975560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:47:58.976069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:47:59.107925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:47:59.119159 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f6fdc21e-3a6c-46cf-ba10-bf29f8a542bf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161164 Apr 20 18:47:59.119816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 509/1015] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:47:58 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:00.137820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:00.138521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:00.147230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:00.147747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:00.148593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:00.149090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:00.282436 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:00.293816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-30439bd4-a0e2-4c25-8eec-8ba31b899623 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160205 Apr 20 18:48:00.294444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 507/1016] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:00 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:01.312871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:01.313539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:01.321821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:01.322332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:01.323245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:01.323946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:01.449375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:01.459932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-53172ca7-6d72-4f73-bfd6-f6b2c783bea3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151222 Apr 20 18:48:01.460845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 510/1017] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:01 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:02.478250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:02.479073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:02.487190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:02.488297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:02.489042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:02.489530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:02.618745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:02.629026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-090d1a6d-fb47-4470-a5e7-90d24b6d8333 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154901 Apr 20 18:48:02.629653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 508/1018] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:02 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:03.648181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:03.648669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:03.656649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:03.657165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:03.658070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:03.658599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:03.787408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:03.797650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0a00e6dd-acd4-4ad1-bf74-990601e7e6a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154333 Apr 20 18:48:03.798291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 511/1019] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:03 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:04.816235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:04.816914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:04.824943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:04.825448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:04.826293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:04.826816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:04.953543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:04.963856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b32ff503-bc0d-444c-bb45-d938d0133c0c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151894 Apr 20 18:48:04.964497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 509/1020] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:04 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:05.981942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:05.982729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:05.991992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:05.992524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:05.993720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:05.993985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:06.133049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:06.144271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-184fe3de-0154-49fe-8d01-5eee717ad52d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.166615 Apr 20 18:48:06.144912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 512/1021] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:05 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:07.163439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:07.164360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:07.174920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:07.175507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:07.176378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:07.176880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:07.311970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:07.323294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e051ca7d-590a-46c2-8c92-66a7b352e151 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.164287 Apr 20 18:48:07.323936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 510/1022] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:07 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:08.344892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:08.345557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:08.355000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:08.355513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:08.356361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:08.356860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:08.482505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:08.492864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6219f8fc-4225-4c86-a718-658cbedd7a09 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154194 Apr 20 18:48:08.493500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 513/1023] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:08 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:09.511728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:09.512408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:09.520427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:09.520942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:09.521781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:09.522274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:09.647952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:09.658206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cf840bf0-e1a9-4bc9-8dfb-58b192116111 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150674 Apr 20 18:48:09.658863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 511/1024] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:09 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:10.677404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:10.678063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:10.687217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:10.687721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:10.688556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:10.689040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:10.818091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:10.829040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4304b1e0-b3dd-42ff-8ca1-11342b0db8eb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155680 Apr 20 18:48:10.829673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 514/1025] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:10 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:11.847530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:11.848208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:11.856276 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:11.856780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:11.857618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:11.858110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:11.983985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:11.995535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9d89579a-dbe0-461e-897e-bef061e842d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152103 Apr 20 18:48:11.996202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 512/1026] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:11 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:48:13.014315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:13.015044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:13.023638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:13.024146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:13.024992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:13.025496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:13.153052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:13.163106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3ad2bc26-d9ca-453b-86fa-2319211fc579 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153023 Apr 20 18:48:13.163768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 515/1027] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:13 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:14.183028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:14.183669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:14.192724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:14.193294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:14.194238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:14.194857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:14.340287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:14.351970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5ed11d50-73d4-4830-98f8-488a686d7a8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.173050 Apr 20 18:48:14.352584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 513/1028] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:14 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:15.372363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:15.373032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:15.381027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:15.381582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:15.382418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:15.383037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:15.511088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:15.521615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-325f88b9-2b20-4323-8247-5ef31c8f8430 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153359 Apr 20 18:48:15.522261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 516/1029] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:15 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:16.540184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:16.540742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:16.549376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:16.549964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:16.550897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:16.551556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:16.677166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:16.689051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3ec0c051-2e74-4ec0-bf5c-0277c4762416 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153004 Apr 20 18:48:16.689666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 514/1030] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:16 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:17.707997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:17.708581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:17.718672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:17.719212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:17.720048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:17.720566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:17.849589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:17.859721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6ea910eb-5b63-42a6-9304-4f4912e65772 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155994 Apr 20 18:48:17.860351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 517/1031] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:17 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:18.878395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:18.879095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:18.887534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:18.888040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:18.888875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:18.889370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:19.014825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:19.025385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2b967692-8748-4230-a6b7-c274d2270703 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151051 Apr 20 18:48:19.026002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 515/1032] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:18 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:48:20.044147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:20.044792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:20.053251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:20.053251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:20.054022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:20.054569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:20.188521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:20.200801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2ac42045-eb4c-42f3-a9f7-3b65fc679694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161186 Apr 20 18:48:20.201688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 518/1033] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:20 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:21.221594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:21.222269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:21.231634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:21.232141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:21.233003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:21.233481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:21.367823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:21.378041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-42553a82-09d7-4e7a-a974-769f9f65b097 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160568 Apr 20 18:48:21.378740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 516/1034] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:21 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:22.396823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:22.397496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:22.405406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:22.405914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:22.406821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:22.407317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:22.533990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:22.549256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3ed011b4-d4be-4ab2-aeaf-337d14d7cd81 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156431 Apr 20 18:48:22.550071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 519/1035] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:22 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:23.569676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:23.570391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:23.578430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:23.578979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:23.579803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:23.580498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:23.714012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:23.724143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a19799dd-14c9-4828-8982-e32b256792bc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159046 Apr 20 18:48:23.724763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 517/1036] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:23 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:24.743693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:24.744411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:24.753197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:24.753701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:24.754569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:24.755056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:24.886423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:24.896365 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c005aae-fc7e-4d7a-bf8f-4e79ca05d02b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157482 Apr 20 18:48:24.896990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 520/1037] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:24 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:25.916288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:25.916971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:25.926741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:25.927346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:25.928264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:25.928868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:26.067278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:26.079623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9ecb3561-ce83-48c1-9b78-d7f60d1a1227 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.167993 Apr 20 18:48:26.080313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 518/1038] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:25 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:27.100063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:27.100791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:27.110068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:27.110627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:27.111519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:27.112013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:27.254171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:27.265131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-82a2e708-9ec8-4fac-8193-90a6eec8870a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.169157 Apr 20 18:48:27.265764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 521/1039] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:27 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:28.286224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:28.286954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:28.296942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:28.297561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:28.298535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:28.299082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:28.441890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:28.453902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-71a3d4bc-0fe0-4059-b22d-bc57f4538397 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.172172 Apr 20 18:48:28.454549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 519/1040] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:28 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:29.474277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:29.475160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:29.486333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:29.486968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:29.488040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:29.488946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:29.636397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:29.648311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b16e1361-c847-4dea-a535-648da865786c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.179074 Apr 20 18:48:29.648999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 522/1041] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:29 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:30.670854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:30.671664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:30.683883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:30.685386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:30.686911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:30.687766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:30.871098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:30.881384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e15b11c6-c685-4ee2-8064-978c8e6f7fcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.216129 Apr 20 18:48:30.882013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 520/1042] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:30 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:31.900888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:31.901629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:31.910180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:31.910723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:31.911568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:31.912091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:32.046090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:32.057130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2d1c9647-16ab-44a9-b848-7b16b8fa716b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160263 Apr 20 18:48:32.057797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 523/1043] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:31 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:33.076116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:33.076699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:33.085032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:33.085562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:33.086493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:33.087017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:33.213643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:33.224359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a4f7b068-a68a-48a4-861e-2ba4e0d2914c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152489 Apr 20 18:48:33.224977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 521/1044] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:33 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:48:34.243464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:34.244153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:34.252674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:34.253170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:34.254005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:34.254509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:34.383940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:34.394154 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-30a1e554-fd9d-4ead-80ad-e9cf836057d6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154728 Apr 20 18:48:34.394834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 524/1045] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:34 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:35.413569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:35.414278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:35.424209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:35.424744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:35.425639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:35.426179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:35.572821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:35.586043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a988c811-6bc2-42f7-ae49-426e65a1d24a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.176957 Apr 20 18:48:35.587133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 522/1046] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:35 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:36.605810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:36.607010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:36.616362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:36.616875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:36.617909 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:36.618401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:36.746495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:36.758153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-19921cf1-fa96-4a11-b051-2a2507a8f2dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156340 Apr 20 18:48:36.759097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 525/1047] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:36 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:37.778160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:37.779771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:37.790438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:37.791099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:37.792272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:37.792932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:37.929163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:37.934177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f7aacc2a-7e12-4376-a071-347e9b656852 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161175 Apr 20 18:48:37.934858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 523/1048] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:37 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:38.954129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:38.954913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:38.964492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:38.965000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:38.965847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:38.966338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:39.096650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:39.107624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-41cba172-e1e8-474a-a319-6d249491fac1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157546 Apr 20 18:48:39.108935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 526/1049] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:38 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:40.126817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:40.127694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:40.138290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:40.138950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:40.140613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:40.141186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:40.275383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:40.285380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d596ca0a-201f-4bc8-a989-725a3c499a46 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.163221 Apr 20 18:48:40.286006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 524/1050] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:40 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:41.304104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:41.304783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:41.312702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:41.313211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:41.314043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:41.314556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:41.445781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:41.455850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-98d8ac99-0a1e-4a35-81dc-3d2dee86d5ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155909 Apr 20 18:48:41.456470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 527/1051] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:41 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:42.474572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:42.475243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:42.483472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:42.483976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:42.484814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:42.485300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:42.614709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:42.624627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1a7c9fd8-6e2f-43fd-b404-ccf6c97ae912 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154282 Apr 20 18:48:42.625348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 525/1052] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:42 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:43.644716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:43.645301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:43.653312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:43.653815 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:43.654680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:43.655167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:43.780004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:43.791702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7ed56d76-d6dc-440d-a9d0-9853e97748c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151320 Apr 20 18:48:43.792343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 528/1053] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:43 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:44.810486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:44.811211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:44.820699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:44.821212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:44.822052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:44.822577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:44.946178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:44.957025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91cfdfc5-c292-4ab4-9f19-353a30befff7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150729 Apr 20 18:48:44.957644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 526/1054] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:44 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:45.975525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:45.976191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:45.984097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:45.984593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:45.985418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:45.985901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:46.114778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:46.125190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6756bdf0-753a-4a83-b57e-ac7f5f62211f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153972 Apr 20 18:48:46.125810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 529/1055] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:45 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:47.142550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:47.143218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:47.151473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:47.151978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:47.152823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:47.153420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:47.279187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:47.289980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4de3828f-42e4-469c-83d9-d54ed575fd11 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151456 Apr 20 18:48:47.290648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 527/1056] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:47 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:48.308914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:48.309586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:48.317805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:48.318320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:48.319184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:48.319682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:48.445827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:48.456402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-45c9fedc-aff8-4955-87ce-df5624f5185f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151590 Apr 20 18:48:48.457025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 530/1057] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:48 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:49.475056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:49.475714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:49.484181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:49.484682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:49.485509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:49.485997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:49.619795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:49.631045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2b117afc-2cc1-47be-b7c9-e1a55c6de448 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159831 Apr 20 18:48:49.631676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 528/1058] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:49 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:50.651134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:50.651806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:50.660090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:50.660602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:50.661453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:50.661950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:50.789990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:50.800811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-54ab0b9f-18a8-43cb-b3a1-dd7a71321def tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153853 Apr 20 18:48:50.801463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 531/1059] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:50 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:51.820614 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:51.821282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:51.829988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:51.830520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:51.831332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:51.831818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:51.963695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:51.975130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-04dc5de5-89ab-4c2a-af1a-cc7d5d526ba8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.158945 Apr 20 18:48:51.975766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 529/1060] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:51 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:52.993413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:52.994078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:53.002913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:53.003411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:53.004245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:53.004739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:53.133942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:53.144493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-63afac30-3bcc-423c-aa38-189c8f2ff185 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155025 Apr 20 18:48:53.145135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 532/1061] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:52 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:54.165521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:54.166362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:54.176258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:54.176759 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:54.177600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:54.178086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:54.314450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:54.324897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f9ff013-1aee-4a84-9bfd-fd998e65e281 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.166219 Apr 20 18:48:54.325502 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 530/1062] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:54 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:55.343023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:55.343692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:55.351745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:55.352250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:55.353097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:55.353589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:55.481222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:55.491788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c84f1fbe-b937-4b4b-b7b2-33ba8cdd12c1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153298 Apr 20 18:48:55.492413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 533/1063] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:55 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:56.510500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:56.511176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:56.519729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:56.520237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:56.521066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:56.521557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:56.651736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:56.662158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2782e1c4-38f2-4adc-a2f1-1a136ad60f64 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155832 Apr 20 18:48:56.662886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 531/1064] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:56 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:57.681186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:57.681859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:57.690412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:57.690952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:57.691791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:57.692285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:57.815158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:57.825295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1c6a03ff-6409-4b94-8368-6aaaa304731c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.148149 Apr 20 18:48:57.825925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 534/1065] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:57 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:58.843353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:48:58.844023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:48:58.852192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:58.852703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:58.853527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:48:58.854016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:48:58.989132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:48:58.999275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2e9756a5-04f3-4742-8da4-bac81df41a1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160101 Apr 20 18:48:58.999888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 532/1066] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:48:58 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:00.018332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:00.019030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:00.027351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:00.027978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:00.028960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:00.030184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:00.162379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:00.173278 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d006098-cc69-4355-a723-f172cce9761f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159518 Apr 20 18:49:00.173905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 535/1067] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:00 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:01.191498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:01.192064 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:01.200623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:01.201126 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:01.202589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:01.203182 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:01.327787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:01.337620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b01e3768-b085-410c-8f6a-108fe8299aeb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150352 Apr 20 18:49:01.338226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 533/1068] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:01 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:49:02.356025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:02.356626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:02.365160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:02.365668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:02.366520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:02.367013 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:02.492209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:02.502002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7b6e6b71-68d3-4e78-8be8-c4aec495f652 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150120 Apr 20 18:49:02.502640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 536/1069] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:02 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:03.524934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:03.526043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:03.540376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:03.541226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:03.542737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:03.543551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:03.709850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:03.721197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fd93297a-8694-42a7-8667-c2ff598f2efd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.203406 Apr 20 18:49:03.722015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 534/1070] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:03 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:04.740438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:04.741144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:04.749241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:04.749752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:04.750621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:04.751117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:04.875542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:04.886066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-af1e50c3-c165-4ecb-b62d-2f8a67ff49d4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.149743 Apr 20 18:49:04.886723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 537/1071] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:04 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:05.905170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:05.905850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:05.915716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:05.916226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:05.917067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:05.917561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:06.265979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:06.276089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c72e1bf-b222-46dd-9a6a-6ff2f5f4458a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.375211 Apr 20 18:49:06.276716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 535/1072] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:05 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:07.294766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:07.295434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:07.303353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:07.303858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:07.304696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:07.305188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:07.430813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:07.440809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8bc1fe1-5e80-49cc-86c0-59372f598f7f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150172 Apr 20 18:49:07.441425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 538/1073] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:07 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:08.459498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:08.460091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:08.468135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:08.468678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:08.469520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:08.470012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:08.594873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:08.604906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2d2b37e7-5ca7-4ee0-95d7-0729342c803d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.149554 Apr 20 18:49:08.605534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 536/1074] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:08 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:09.623347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:09.624541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:09.632507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:09.633016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:09.633848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:09.634333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:09.766015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:09.776366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a5f1d6b3-ea8b-47f4-be35-191affeaa3b3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157131 Apr 20 18:49:09.777215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 539/1075] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:09 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:10.794565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:10.795221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:10.804216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:10.804728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:10.805580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:10.806078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:10.941785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:10.953297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2aff1c64-e713-44a3-89be-992dbb7a59b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.162721 Apr 20 18:49:10.953926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 537/1076] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:10 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:11.862921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:49:11.863557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:49:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:49:11.972328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:11.972997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:11.981143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:11.981653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:11.982514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:11.982998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:12.107454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:12.117415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7fba002e-dbee-4a33-9c58-797b19291f73 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.149705 Apr 20 18:49:12.118027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 540/1077] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:11 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:13.135980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:13.136587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:13.145274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:13.145785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:13.146649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:13.147150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:13.269137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:13.279475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f1efeef-a2ed-452d-9751-d5b953997cb6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.147570 Apr 20 18:49:13.280195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 538/1078] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:13 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:14.297662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:14.298559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:14.306281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:14.306838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:14.307677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:14.308171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:14.434987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:14.445612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4d2a7ef5-ac53-4bdd-b888-e03be798c3b4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152047 Apr 20 18:49:14.446226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 541/1079] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:14 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:15.464499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:15.465219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:15.473997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:15.474597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:15.475385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:15.475881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:15.597263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:15.608107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-be808e37-ae3d-43b6-bad8-9a6c221041da tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.147710 Apr 20 18:49:15.608724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 539/1080] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:15 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:16.626298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:16.626923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:16.634973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:16.635486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:16.636328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:16.636825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:16.763488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:16.774123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a6608308-06fe-41f1-a278-e8203f4e46a9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152010 Apr 20 18:49:16.774787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 542/1081] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:16 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:17.792628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:17.793316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:17.801794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:17.802294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:17.803174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:17.803699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:17.934405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:17.945200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-76690377-4d8c-4073-a5b9-36d067077b1d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156778 Apr 20 18:49:17.945805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 540/1082] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:17 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:18.963168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:18.963843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:18.971940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:18.972447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:18.973287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:18.973827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:19.097873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:19.107771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-51e191b8-9c1d-44dc-803d-449af10f7d15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.148683 Apr 20 18:49:19.108371 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 543/1083] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:18 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:20.125190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:20.125854 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:20.134092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:20.134638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:20.135486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:20.135984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:20.262916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:20.273669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2e18dc58-8c3e-4de5-b2d9-3a8226a945de tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152544 Apr 20 18:49:20.274293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 541/1084] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:20 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:21.291125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:21.291791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:21.300293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:21.300796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:21.301623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:21.302106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:21.432348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:21.442507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2560c8d9-1e57-410b-b535-13edde0c3100 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155382 Apr 20 18:49:21.443450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 544/1085] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:21 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:22.461729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:22.462399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:22.470658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:22.471170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:22.472066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:22.472628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:22.600637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:22.611804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ed8dda4c-0e73-4299-b150-400e3f5c2468 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154332 Apr 20 18:49:22.612451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 542/1086] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:22 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:23.629675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:23.630399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:23.638508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:23.639026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:23.640505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:23.640932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:23.776098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:23.788097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9ce1ffe1-ad8d-43c5-bd96-13ad45ff15d0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.162464 Apr 20 18:49:23.788827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 545/1087] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:23 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:24.808767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:24.809516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:24.817897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:24.818691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:24.819542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:24.820038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:24.952470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:24.963712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-749e68bc-e269-41e5-b685-b1330d2999ad tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159400 Apr 20 18:49:24.964346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 543/1088] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:24 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:25.989308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:25.990552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:26.003402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:26.004164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:26.005459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:26.006295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:26.145501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:26.157484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c57f0a5-6ecf-497d-acd3-813f1de60425 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.176044 Apr 20 18:49:26.158140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 546/1089] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:25 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:27.176020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:27.176691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:27.190167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:27.190777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:27.191646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:27.192148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:27.320137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:27.337578 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-16814779-0c66-4c24-b005-ff43a502ffb3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.165465 Apr 20 18:49:27.338672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 544/1090] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:27 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:27.799174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:49:27.799477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:49:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:49:28.360573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:28.361183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:28.369349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:28.369920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:28.370890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:28.371446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:28.514995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:28.525916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ebe7e41-dc7d-4c32-a8f9-43094aa413aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.169429 Apr 20 18:49:28.527802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 547/1091] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:28 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:29.546704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:29.547389 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:29.560445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:29.560960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:29.563040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:29.563040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:29.695767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:29.706764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c1f44ce1-a829-4c37-8776-eb6c59e2c0fe tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.164842 Apr 20 18:49:29.707404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 545/1092] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:29 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:30.725340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:30.726070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:30.735212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:30.735748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:30.736574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:30.737069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:30.879254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:30.890062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f906750-10cf-4066-b9f2-bbd68c083d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.168741 Apr 20 18:49:30.890756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 548/1093] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:30 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:31.909557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:31.910232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:31.918384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:31.918926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:31.919766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:31.920262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:32.195098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:32.206246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f978de6b-bc9d-4a5b-9cca-6c1e5ac641ae tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.300999 Apr 20 18:49:32.206971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 546/1094] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:31 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:32.756130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:49:32.756440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:49:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:49:33.226477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:33.227146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:33.235765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:33.236268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:33.237103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:33.237592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:33.370917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:33.382141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8b6c2c21-4522-4bfc-b200-f4e08d9a5be3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159725 Apr 20 18:49:33.382803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 549/1095] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:33 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:34.401559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:34.402286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:34.412732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:34.413555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:34.414812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:34.415653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:34.572842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:34.584780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-33c42adb-214d-45d2-89d9-a3c4c21e7148 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.187637 Apr 20 18:49:34.585422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 547/1096] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:34 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:35.604539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:35.605215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:35.613227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:35.613729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:35.614609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:35.615097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:35.755341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:35.766501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dd7d5913-ad1a-418c-9b2d-989bff1c6109 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.166226 Apr 20 18:49:35.767375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 550/1097] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:35 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:36.785208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:36.785913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:36.794373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:36.794916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:36.795786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:36.796271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:36.932832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:36.944266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-08f19335-7bcc-40f0-9add-707fc09a425f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.163059 Apr 20 18:49:36.944897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 548/1098] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:36 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:37.963242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:37.963922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:37.977244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:37.978088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:37.979559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:37.980354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:38.119902 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:38.130617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9a32d88a-dc35-4111-b67c-18b048eb3b14 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.171321 Apr 20 18:49:38.131270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 551/1099] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:37 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:39.148271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:39.148926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:39.157326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:39.157829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:39.158712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:39.159200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:39.290799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:39.301254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cb71d659-ec46-4ff7-a6fd-f4892617a9c9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157269 Apr 20 18:49:39.301893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 549/1100] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:39 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:40.321210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:40.321874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:40.330640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:40.331141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:40.331993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:40.332482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:40.462186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:40.473383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ca33ded0-7d96-4f19-9289-921838129c60 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156453 Apr 20 18:49:40.474024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 552/1101] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:40 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:41.492136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:41.492846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:41.501157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:41.501653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:41.502540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:41.503019 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:41.629511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:41.640331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b1b2fd05-247a-4a1c-85cb-aa04f07e99a4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152425 Apr 20 18:49:41.641178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 550/1102] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:41 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:42.658715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:42.659305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:42.667554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:42.668071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:42.668931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:42.669431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:42.802915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:42.816679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-89907866-726e-482b-a2b0-9033227cebbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.162094 Apr 20 18:49:42.817314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 553/1103] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:42 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:43.835463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:43.836127 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:43.844985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:43.845491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:43.846349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:43.846875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:44.006672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:44.023807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9a7707a0-81d6-4873-a77d-82f2e3c93159 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.192168 Apr 20 18:49:44.024789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 551/1104] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:43 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:45.049820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:45.051088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:45.059971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:45.060476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:45.061445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:45.061934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:45.212021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:45.223692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ea83850f-ad1a-41cb-ac43-d50dfc8fb683 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.179185 Apr 20 18:49:45.224413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 554/1105] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:45 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:46.248473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:46.249236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:46.257441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:46.257952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:46.258837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:46.259329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:46.391717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:46.402140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5723242f-b36a-446f-bd7f-46b0c5141628 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157581 Apr 20 18:49:46.402684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 552/1106] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:46 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:49:47.426073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:47.426780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:47.435022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:47.435545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:47.436439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:47.436938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:47.564788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:47.575567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d7ba64aa-3a94-49fd-9a6c-7f19302315f1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153561 Apr 20 18:49:47.576195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 555/1107] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:47 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:48.594884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:48.595555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:48.604207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:48.604636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:48.605507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:48.606010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:48.737958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:48.749042 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0f280edd-f60f-4ad9-8d1c-43ff44a0a354 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.158000 Apr 20 18:49:48.749699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 553/1108] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:48 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:49.768204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:49.768872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:49.777094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:49.777601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:49.778452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:49.778970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:49.911049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:49.923069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2da06e80-63a4-4dea-91c2-c663b0c06317 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159130 Apr 20 18:49:49.923787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 556/1109] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:49 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:50.942091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:50.942718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:50.951928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:50.952471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:50.953325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:50.953825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:51.088481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:51.099233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cf0e4e2e-56ac-4234-b696-055b40a5e09e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161363 Apr 20 18:49:51.099881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 554/1110] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:50 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:52.117315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:52.117994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:52.127250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:52.127250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:52.127974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:52.128404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:52.265005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:52.276054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e9913d10-fe01-40dc-90fb-7b6de93866ce tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.162691 Apr 20 18:49:52.276457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 557/1111] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:52 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:53.294916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:53.295665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:53.303775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:53.304281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:53.305170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:53.305659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:53.436732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:53.447411 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3cf3e15a-515d-4c8d-ba22-de3b9ffc48c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156496 Apr 20 18:49:53.448251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 555/1112] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:53 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:54.467312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:54.467872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:54.476023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:54.476524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:54.477372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:54.477862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:54.645140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:54.655830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-73cde5cf-cd82-416c-bd98-b8045b303d32 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.192868 Apr 20 18:49:54.656572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 558/1113] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:54 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:55.674418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:55.675024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:55.683364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:55.683873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:55.684725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:55.685222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:55.812346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:55.823294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4f4eb4fb-2b0f-491e-8ef0-c9976f5a4dc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153508 Apr 20 18:49:55.823923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 556/1114] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:55 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:56.841271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:56.841943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:56.851893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:56.852391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:56.853232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:56.853718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:56.984623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:56.994948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1f57cf7e-ba39-4156-a3d9-81f01d2300ca tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157600 Apr 20 18:49:56.995592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 559/1115] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:56 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:58.015102 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:58.015978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:58.024413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:58.024915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:58.025773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:58.026265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:58.159325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:58.169665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e44d37fc-8997-499e-8d62-fcea63621983 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159734 Apr 20 18:49:58.170929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 557/1116] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:58 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:59.189639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:49:59.190378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:49:59.198808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:59.199319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:59.200164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:49:59.200660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:49:59.331482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:49:59.343124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7b187f8d-ee84-47f9-8795-63f473294bbb tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157815 Apr 20 18:49:59.343773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 560/1117] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:49:59 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:00.360987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:00.361660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:00.369816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:00.370330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:00.371241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:00.371739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:00.502235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:00.512622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-05dc6974-fcc3-492c-8cb6-5bb5d787bf27 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155626 Apr 20 18:50:00.513245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 558/1118] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:00 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:01.531619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:01.532300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:01.540678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:01.541181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:01.542036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:01.542552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:01.670151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:01.680654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-48d4918e-28ae-4eff-adb3-653b623e3016 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153042 Apr 20 18:50:01.681306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 561/1119] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:01 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:02.699940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:02.700572 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:02.708752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:02.709257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:02.710104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:02.710633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:02.837286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:02.847603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f9570428-10c5-46ac-957e-64f984871c8b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151821 Apr 20 18:50:02.848245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 559/1120] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:02 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:03.866427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:03.867112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:03.875266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:03.875948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:03.876792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:03.877280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:04.008808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:04.019539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-379d9642-8739-4bac-83c9-da7465f650a3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157159 Apr 20 18:50:04.020188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 562/1121] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:03 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:05.037781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:05.038445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:05.047445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:05.047962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:05.048827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:05.049325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:05.187805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:05.198260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f82c40de-6df1-412a-a438-07267b102d5c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.164691 Apr 20 18:50:05.198905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 560/1122] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:05 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:06.218296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:06.219250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:06.229866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:06.230817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:06.231697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:06.232203 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:06.372739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:06.383765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b49fa7e5-fb05-433d-bce9-fb4eb9b4e2ec tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.170046 Apr 20 18:50:06.384405 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 563/1123] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:06 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:07.403145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:07.403840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:07.412608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:07.413122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:07.414059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:07.414621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:07.550511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:07.566816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2f54e545-1caa-4d66-8a20-0351433d0d6a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.167281 Apr 20 18:50:07.567777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 561/1124] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:07 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:08.589814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:08.590548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:08.598576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:08.599095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:08.599954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:08.600449 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:08.728905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:08.739621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6dca01a3-71c2-4724-ace2-ff0ec3243210 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153944 Apr 20 18:50:08.740255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 564/1125] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:08 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:09.760059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:09.760732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:09.768802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:09.769312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:09.770160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:09.770690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:09.898746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:09.909214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-efadaee0-4ac8-4caa-a7fa-1b614de7241b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153519 Apr 20 18:50:09.909834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 562/1126] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:09 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:10.927471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:10.928084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:10.935940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:10.936451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:10.937292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:10.937786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:11.063971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:11.074331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-423c1bfa-acb7-47a1-a54a-4da08f67d0c5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150973 Apr 20 18:50:11.075887 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 565/1127] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:10 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:12.094859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:12.095521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:12.103414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:12.103913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:12.104739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:12.105225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:12.234428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:12.244446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-86fe85fa-3b8a-4391-b8cc-b5a29e00936e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154207 Apr 20 18:50:12.245070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 563/1128] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:12 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:13.267090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:13.267764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:13.276205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:13.276710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:13.277578 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:13.278108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:13.430398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:13.441808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eee40a4a-1fc7-4e25-a006-fe89d8c09bf6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.182186 Apr 20 18:50:13.442799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 566/1129] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:13 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:14.462058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:14.462753 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:14.471153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:14.471659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:14.472484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:14.472969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:14.607262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:14.618403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a2dd3e26-f70a-4982-83a6-f2796b5d14d9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161500 Apr 20 18:50:14.619152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 564/1130] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:14 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:50:15.643760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:15.644513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:15.652388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:15.652890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:15.653752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:15.654288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:15.789072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:15.800021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6d0295fd-73b8-4acd-aabb-14ae778f9ece tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160249 Apr 20 18:50:15.800658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 567/1131] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:15 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:16.818426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:16.819123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:16.828485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:16.828991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:16.829832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:16.830327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:16.957922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:16.968612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cde5bbdc-a4b9-48c3-90c8-0a73eea0d8d7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154140 Apr 20 18:50:16.969330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 565/1132] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:16 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:17.986388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:17.987091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:17.995250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:17.995748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:17.996702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:17.997199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:18.274719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:18.285259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-717b1668-e1db-4b55-86ef-d748425c5b10 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.302941 Apr 20 18:50:18.285879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 568/1133] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:17 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:19.304544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:19.305272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:19.313486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:19.314012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:19.314929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:19.315384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:19.446412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:19.457096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7d812f9d-d756-4344-8246-ee94edf62a88 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157528 Apr 20 18:50:19.457716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 566/1134] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:19 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:20.476105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:20.476771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:20.486004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:20.486520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:20.487370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:20.487857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:20.621870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:20.634081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1933e31e-f518-4791-b0c7-d7f2bd335434 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161976 Apr 20 18:50:20.634749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 569/1135] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:20 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:21.653509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:21.654184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:21.662391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:21.662934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:21.663844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:21.664285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:21.795776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:21.806712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b01b4675-7ddf-4894-91c3-029ca5863516 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157155 Apr 20 18:50:21.807338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 567/1136] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:21 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:22.825862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:22.826619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:22.834546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:22.835286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:22.836266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:22.836756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:22.961913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:22.972605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-77ef6159-f3c6-46b2-97f8-97eb18cdb6b2 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150809 Apr 20 18:50:22.973228 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 570/1137] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:22 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:23.991202 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:23.991875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:24.000486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:24.000997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:24.001845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:24.002375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:24.127077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:24.137096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-05bcebc0-8b21-4306-952f-9248a00a5e3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150216 Apr 20 18:50:24.137731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 568/1138] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:23 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:25.164458 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:25.165439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:25.178667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:25.179441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:25.180846 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:25.181720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:25.324046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:25.334217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6fccfee9-62bf-4f0e-b714-71b31e3c6694 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.176750 Apr 20 18:50:25.334874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 571/1139] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:25 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:26.353176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:26.353739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:26.361824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:26.362330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:26.363230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:26.363723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:26.492800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:26.503597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1ba4ee94-ad68-4624-b2b6-44f90b70533b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154684 Apr 20 18:50:26.504233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 569/1140] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:26 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:27.523207 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:27.523873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:27.533491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:27.533991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:27.534871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:27.535354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:27.664408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:27.674800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c29fef7c-13b4-4137-a9c7-90a819268b3c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156315 Apr 20 18:50:27.675341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 572/1141] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:27 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:50:28.693148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:28.693711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:28.702218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:28.702772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:28.703610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:28.704115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:28.838090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:28.858493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-631e0734-c5a1-428f-b055-dd5724b095f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.168374 Apr 20 18:50:28.859772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 570/1142] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:28 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:29.877738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:29.878396 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:29.886956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:29.887460 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:29.888292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:29.888875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:30.018195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:30.028496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f5e02521-574a-4d48-80b8-1a19495d973b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155574 Apr 20 18:50:30.029107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 573/1143] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:29 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:31.047299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:31.048051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:31.057106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:31.057541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:31.058403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:31.058927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:31.190105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:31.201785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-385375cd-3cc5-4ce9-a41a-9b3aebd9cad4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.158954 Apr 20 18:50:31.202412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 571/1144] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:31 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:32.223809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:32.224447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:32.232526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:32.233022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:32.233852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:32.234334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:32.366390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:32.377097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0679c068-b79c-4b0f-be42-00f266cce098 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160137 Apr 20 18:50:32.377724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 574/1145] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:32 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:33.396039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:33.396701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:33.405332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:33.405836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:33.406700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:33.407196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:33.535068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:33.545049 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-13ebce09-013f-40c3-8c77-c581cfea0c9c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153017 Apr 20 18:50:33.545673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 572/1146] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:33 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:34.563993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:34.564667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:34.573141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:34.573647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:34.574521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:34.575026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:34.719680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:34.729849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-afc554f9-ed7b-499f-98ec-3535ebdbd7ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.170424 Apr 20 18:50:34.730492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 575/1147] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:34 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:35.748464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:35.749352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:35.757264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:35.757777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:35.758664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:35.759163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:35.890093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:35.901576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fde1c3c5-a641-4f00-8006-4a57e54ce162 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157369 Apr 20 18:50:35.902233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 573/1148] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:35 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:36.923303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:36.923965 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:36.931923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:36.932424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:36.933262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:36.933761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:37.069511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:37.080336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e74da6ae-3672-4800-8675-f7f09b951278 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.162901 Apr 20 18:50:37.080975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 576/1149] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:36 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:38.098803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:38.099481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:38.108270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:38.108781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:38.109637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:38.110134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:38.239342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:38.250748 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-34cc5c1f-6499-43d7-b3da-e16c10b119b9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155953 Apr 20 18:50:38.251399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 574/1150] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:38 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:39.269287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:39.269891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:39.278026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:39.278702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:39.279640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:39.280136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:39.408312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:39.418802 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d1df40e-e024-48a3-b6f6-ef3dc7be94f6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154416 Apr 20 18:50:39.419434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 577/1151] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:39 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:40.438757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:40.439422 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:40.449338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:40.449842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:40.450724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:40.451249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:40.588045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:40.599165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b02b3ff1-8749-494c-80d1-69386bd6579a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.165581 Apr 20 18:50:40.599795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 575/1152] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:40 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:41.618188 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:41.618891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:41.627065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:41.627577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:41.628437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:41.628935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:41.758018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:41.768911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f1fe0ed-a8d2-475a-a38c-d3ccfc26d975 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154743 Apr 20 18:50:41.769553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 578/1153] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:41 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:42.790546 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:42.791725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:42.799117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 20 18:50:42.802437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:42.802975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:42.803829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:42.804331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:42.936834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:42.949771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8c22b320-6092-4c2c-a531-ac23477618a5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.165769 Apr 20 18:50:42.950668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 576/1154] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:42 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:43.966648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 20 18:50:43.970690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:43.971350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:43.979336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:43.979834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:43.980664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:43.981148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:44.104527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:44.114636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ab8294d5-8fc8-4162-94ea-e513121ee43d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.149245 Apr 20 18:50:44.115261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 579/1155] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:43 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:45.132223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:45.132829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:45.158939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:45.159454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:45.160312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:45.160807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:45.198209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42772. Apr 20 18:50:45.286606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:45.297441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3c9502bd-73e9-40ed-ad03-ac47ecdda470 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.169299 Apr 20 18:50:45.298082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 577/1156] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:45 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:46.316153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:46.316798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:46.336608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:46.337128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:46.337988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:46.338507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:46.375857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42780. Apr 20 18:50:46.470542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:46.480816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d805b308-d0d1-4c30-a66d-1e9e1fc0c6c6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.168742 Apr 20 18:50:46.481548 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 580/1157] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:46 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:47.499517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:47.500156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:47.508069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:47.508579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:47.509418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:47.509910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:47.641036 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:47.653568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b99ca108-71a8-4c15-b72e-49c1fc9373a7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.158113 Apr 20 18:50:47.654829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 578/1158] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:47 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:48.672123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:48.672796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:48.680651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:48.681162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:48.681997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:48.682514 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:48.811189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:48.821470 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-098cd756-49c5-4d3e-9555-e0c4019fb4e5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153940 Apr 20 18:50:48.822087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 581/1159] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:48 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:49.839611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:49.840331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:49.848363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:49.848955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:49.849778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:49.850266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:49.992893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:50.011630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a66bfb2e-9116-4d25-bd8f-280dccc2dca4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.175547 Apr 20 18:50:50.012764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 579/1160] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:49 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:50.356668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:50:50.356836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:50:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:50:51.037848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:51.038680 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:51.048408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:51.048915 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:51.049774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:51.050274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:51.176756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:51.186927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7c819ca2-bd39-41a0-afab-577c1824305b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153259 Apr 20 18:50:51.187567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 582/1161] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:51 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:52.205716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:52.206352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:52.214671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:52.215229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:52.216095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:52.216596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:52.363040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:52.374930 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d18228cf-f149-4c98-9cd7-cd601edcb29e tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.173250 Apr 20 18:50:52.375609 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 580/1162] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:52 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:53.394027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:53.394668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:53.403183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:53.403682 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:53.405111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:53.405602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:53.538003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:53.549978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-921ecfde-adfc-49a8-8962-b3cc39d94bc4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160156 Apr 20 18:50:53.550675 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 583/1163] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:53 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:54.568659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:54.569328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:54.577584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:54.578086 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:54.578948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:54.579437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:54.708504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:54.718962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f20a0bb2-997b-430f-a282-9ee97c431b77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154331 Apr 20 18:50:54.719598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 581/1164] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:54 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:55.737591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:55.738240 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:55.746401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:55.746936 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:55.748313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:55.748809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:55.882541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:55.893532 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-bdf5358d-7d3e-488e-b637-85b8ae84ffb8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160056 Apr 20 18:50:55.894186 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 584/1165] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:55 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:56.912874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:56.914130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:56.922175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:56.922746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:56.923801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:56.924297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:57.054158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:57.065428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f8d98f9d-61db-45d3-9ab7-b3b7bf6b9155 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157473 Apr 20 18:50:57.066081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 582/1166] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:56 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:58.084800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:58.085475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:58.094353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:58.094893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:58.095776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:58.096273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:58.224904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:58.235329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-09821d8f-8f25-4991-98c1-9c7d1595a105 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154568 Apr 20 18:50:58.235984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 585/1167] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:58 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:59.254185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:50:59.254884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:50:59.262863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:59.264043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:59.264886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:50:59.265381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:50:59.390727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:50:59.400742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ce109774-1ceb-4e4e-9ba5-8725796bf2aa tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150694 Apr 20 18:50:59.401370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 583/1168] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:50:59 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:00.419113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:00.419817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:00.427906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:00.428415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:00.429232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:00.429718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:00.558784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:00.569412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a0d26b4a-0a86-40ac-8d95-dc385fc61a16 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154373 Apr 20 18:51:00.570035 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 586/1169] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:00 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:01.588011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:01.588584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:01.596497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:01.597004 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:01.597841 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:01.598331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:01.725988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:01.736052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-124ed77e-cd00-4133-a7dc-b7dff2732a1b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152135 Apr 20 18:51:01.736681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 584/1170] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:01 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:02.754281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:02.754969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:02.763231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:02.764269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:02.765110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:02.765836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:02.895352 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:02.906540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1f550018-c092-44f5-9d67-de37896ecdcc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156285 Apr 20 18:51:02.907162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 587/1171] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:02 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:03.924246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:03.924919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:03.933061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:03.933568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:03.934420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:03.934942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:04.067332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:04.080334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-81ab6455-2094-42a1-a324-ab12db8b7e2b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.159775 Apr 20 18:51:04.081012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 585/1172] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:03 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:05.100346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:05.101056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:05.109239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:05.109745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:05.110622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:05.111114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:05.237367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:05.249199 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-eeed58bf-2be2-4075-b1cd-dd81d376b07c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151485 Apr 20 18:51:05.250044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 588/1173] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:05 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:06.268901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:06.269574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:06.277573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:06.278071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:06.278970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:06.279458 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:06.424501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:06.435796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-759b3e57-b15f-42ce-a359-5de1f694fcbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.170340 Apr 20 18:51:06.436684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 586/1174] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:06 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:51:07.455040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:07.455719 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:07.464520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:07.465074 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:07.465933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:07.467081 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:07.599425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:07.610885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f868dfff-011f-406c-901d-5b6deacec373 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.160390 Apr 20 18:51:07.611556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 589/1175] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:07 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:08.629644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:08.630319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:08.639260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:08.639845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:08.640888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:08.641496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:08.776446 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:08.787664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-14f55f3a-4412-4567-8dc4-c70111e94fba tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.162066 Apr 20 18:51:08.788320 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 587/1176] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:08 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:09.806221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:09.806928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:09.815249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:09.815756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:09.816616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:09.817113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:09.950416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:09.960840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-56a11083-d5a9-46c2-8de6-1eeacb496829 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.158730 Apr 20 18:51:09.961482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 590/1177] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:09 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:10.979663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:10.980338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:10.988434 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:10.988944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:10.989787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:10.990294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:11.118171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:11.128497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ac3cd896-d4cf-4e9a-a918-dbeeb15d1841 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152824 Apr 20 18:51:11.129131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 588/1178] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:10 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:12.147664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:12.148215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:12.156728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:12.157230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:12.158065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:12.158581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:12.284940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:12.296906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ad9d17cb-ed84-452f-9863-5b97ab968bbf tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153465 Apr 20 18:51:12.297535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 591/1179] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:12 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:13.315877 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:13.316552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:13.324722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:13.325233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:13.326067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:13.326589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:13.453092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:13.463483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-057d1ed6-9a32-4bc7-ae8d-54a1bc0eefe7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.151598 Apr 20 18:51:13.464120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 589/1180] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:13 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:14.482327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:14.483567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:14.491779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:14.492282 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:14.493128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:14.493620 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:14.620595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:14.630886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d46bb24f-ac45-4bcd-bb2e-c12adecb63f3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152578 Apr 20 18:51:14.631528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 592/1181] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:14 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:15.649776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:15.650394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:15.658251 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:15.658804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:15.659630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:15.660117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:15.791791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:15.802973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f710d9be-1c24-45d8-bf6a-0176da79786d tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157208 Apr 20 18:51:15.803728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 590/1182] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:15 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:16.822871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:16.823544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:16.832526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:16.832677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:16.833587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:16.834078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:16.964574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:16.975345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-af307d67-3209-4cd1-8d80-3b68006b6a1f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156961 Apr 20 18:51:16.975996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 593/1183] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:16 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:17.993727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:17.994403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:18.003091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:18.003597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:18.004726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:18.004973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:18.135098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:18.145545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a8cf8746-74f1-4fe9-9310-c62ce6f279dc tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.155948 Apr 20 18:51:18.146183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 591/1184] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:17 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:19.165200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:19.166048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:19.174097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:19.174641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:19.175509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:19.176011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:19.307549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:19.317836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-aac927ec-6381-426e-8015-3226aa34f5e3 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156642 Apr 20 18:51:19.318378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 594/1185] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:19 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:20.337094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:20.337743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:20.347073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:20.347530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:20.348390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:20.348890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:20.476103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:20.486287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-adf2f5f9-590a-42b5-8269-587919d2b5f4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153451 Apr 20 18:51:20.486950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 592/1186] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:20 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:21.504501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:21.505173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:21.513822 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:21.514336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:21.515292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:21.515798 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:21.645221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:21.656744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e2afaac6-c970-4af3-a070-8aae79e3d4f9 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156163 Apr 20 18:51:21.657402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 595/1187] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:21 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:22.675885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:22.676477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:22.684672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:22.685172 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:22.686010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:22.686517 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:22.820710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:22.829966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7c0e2469-2f33-41e9-b34b-cd31731da36c tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.158344 Apr 20 18:51:22.830648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 593/1188] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:22 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:23.848928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:23.849592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:23.857800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:23.858322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:23.859226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:23.859718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:23.991804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:24.002904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-daa941bf-a5f2-4fe0-9d8a-f206ce730905 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157896 Apr 20 18:51:24.003552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 596/1189] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:23 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:25.021412 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:25.022082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:25.030105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:25.030646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:25.031492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:25.031989 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:25.159394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:25.169953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ac8448f8-f671-4602-a7f7-46f57f6b10c7 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.152109 Apr 20 18:51:25.170586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 594/1190] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:25 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:26.188233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:26.188878 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:26.197488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:26.197988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:26.198892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:26.199380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:26.328481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:26.338516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c5409f25-4b17-476e-b192-e97ddc05143b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.154495 Apr 20 18:51:26.339138 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 597/1191] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:26 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:27.361615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:27.362889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:27.375889 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:27.376476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:27.377828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:27.378381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:27.528607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:27.545518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d2b510a9-5b80-4dec-835f-fcd3b4be2ebd tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.192225 Apr 20 18:51:27.546506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 595/1192] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:27 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:28.566443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:28.567190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:28.575712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:28.576223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:28.577083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:28.577573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:28.720385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:28.730591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1032c69a-b71e-4269-80b1-e215bf22b0ea tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.168302 Apr 20 18:51:28.731221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 598/1193] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:28 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:29.752406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:29.753744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:29.767817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:29.768612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:29.769963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:29.770801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:29.927942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:29.938747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b29ab7b2-18ef-43f4-bdf0-329c64af0422 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.193274 Apr 20 18:51:29.939379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 596/1194] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:29 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:30.957892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:30.958598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:30.966838 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:30.967347 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:30.968208 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:30.968704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:31.096639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:31.106820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-65cf948b-ed9c-4215-957c-ecd028f3a15f tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.153067 Apr 20 18:51:31.107433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 599/1195] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:30 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:32.125455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:32.126079 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:32.134237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:32.134778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:32.135687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:32.136183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:32.401844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:32.412681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d025529f-d749-4522-8704-24ea8057be3b tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.291997 Apr 20 18:51:32.413315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 597/1196] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:32 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:33.431795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:33.432508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:33.441426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:33.441935 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:33.442810 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:33.443303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:33.573941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:33.584627 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-20a0daec-0072-41ac-a362-416cc97777c4 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.156654 Apr 20 18:51:33.585242 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 600/1197] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:33 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:34.602933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:34.603655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:34.611749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:34.612259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:34.613117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:34.613616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:34.738235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:34.749044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-26aa3754-3412-4a36-aea2-ee52a1375fc8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.150685 Apr 20 18:51:34.749681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 598/1198] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:34 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:35.771842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:35.773173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:35.785608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:35.786121 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:35.787047 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:35.787547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:35.918368 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:35.928945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-56d30e15-6858-47b6-95d7-d459c653eb15 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.164362 Apr 20 18:51:35.929602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 601/1199] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:35 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:36.948051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:36.948630 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:36.956765 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:36.957277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:36.958128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:36.958650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:37.117535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:37.127599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b9c1726b-1a33-4981-bfec-031ffe95b3ef tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.184203 Apr 20 18:51:37.128265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 599/1200] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:36 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:38.146164 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:38.146870 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:38.154949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:38.155457 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:38.156298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:38.156784 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:38.304550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:38.315886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2dcaea76-9843-4515-884b-a3c39c1ee747 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.173873 Apr 20 18:51:38.316544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 602/1201] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:38 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:39.334824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:39.335489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:39.344051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:39.344577 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:39.345454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:39.346440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:39.481953 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:39.492200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0c3de66c-19da-4f93-8eaa-cb2e735b793a tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.161493 Apr 20 18:51:39.492912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 600/1202] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:39 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:40.510726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:40.511391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:40.519509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:40.520043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:40.520852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:40.521339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:40.645349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:40.655789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a09e76c6-d548-4175-b5ab-15e70301baf5 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.149217 Apr 20 18:51:40.656403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 603/1203] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:40 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:41.674157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:41.674873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:41.682983 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:41.683486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:41.684330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:41.684847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:41.814763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:41.826867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1029e37e-4109-4900-b5f8-92175484c6b6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157196 Apr 20 18:51:41.827669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 601/1204] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:41 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:42.846586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:42.847388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:42.855665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:42.856169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:42.857670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:42.858166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:42.989947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822060e8b68d4cbc97a4331cd4383a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2e923accea4ab49bf0e323d95333eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:51:43.000141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6c748545-26c2-4da5-8de6-6df62691f365 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 200 len: 1416 microversion: 2.1 time: 0.157767 Apr 20 18:51:43.000774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 604/1205] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:42 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:44.019553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:44.020145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:51:44.028277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:44.029366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:44.030209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:51:44.030735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:51:44.086869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] HTTP exception thrown: Instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e could not be found. Apr 20 18:51:44.087547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Returning 404 to user: Instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:51:44.088462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1a264fea-12f6-4ea4-9a07-c4b854df4dd0 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 404 len: 111 microversion: 2.1 time: 0.073225 Apr 20 18:51:44.089072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 602/1206] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 18:51:44 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:44.098679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-69140a5b-4a54-4c74-911e-3451047f1ee1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '.version_select at 0x7f1a17fff6a8>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:51:44.120437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-69140a5b-4a54-4c74-911e-3451047f1ee1 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439478290" status: 202 len: 0 microversion: 2.1 time: 0.025805 Apr 20 18:51:44.121358 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 605/1207] 10.222.0.22 () {58 vars in 1211 bytes} [Tue Apr 20 18:51:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439478290 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:52:31.879853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:52:31.880465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:52:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:52:45.091826 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:52:45.092418 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:52:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:52:47.818157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:52:47.818728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:52:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:53:06.081221 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:53:06.081771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:53:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:54:10.374595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:54:10.375180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:54:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:54:32.777054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:54:32.777852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:54:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:55:51.898128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:55:51.898849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:55:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:56:05.111629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:56:05.112092 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:56:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:56:07.836859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:56:07.837429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:56:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:56:26.099373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:56:26.099948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:56:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:57:30.392068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:57:30.392668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:57:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:57:52.802674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:57:52.803256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:57:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:59:11.915589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:59:11.916065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:59:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:59:25.129375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:59:25.129931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:59:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:59:27.854646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:59:27.855118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:59:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:59:46.121277 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:59:46.121750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 18:59:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:00:10.156587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:00:10.160253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ab3ff61f-71e0-4df5-99c3-854c3deb8294 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Action: 'create', calling method: .version_select at 0x7f1a208dfbf8>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-91156540"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:10.183695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-ab3ff61f-71e0-4df5-99c3-854c3deb8294 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Getting quotas for project 2ee99eafa14e4e93a5f4a73137557744. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:00:10.187868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-ab3ff61f-71e0-4df5-99c3-854c3deb8294 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Getting quotas for user 72ff5aa8d15840a08503b77cb69c80f6 and project 2ee99eafa14e4e93a5f4a73137557744. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:00:10.603200 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-ab3ff61f-71e0-4df5-99c3-854c3deb8294 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Getting quotas for project 2ee99eafa14e4e93a5f4a73137557744. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:00:10.607350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-ab3ff61f-71e0-4df5-99c3-854c3deb8294 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Getting quotas for user 72ff5aa8d15840a08503b77cb69c80f6 and project 2ee99eafa14e4e93a5f4a73137557744. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:00:10.621730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ab3ff61f-71e0-4df5-99c3-854c3deb8294 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.466478 Apr 20 19:00:10.623062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 603/1208] 10.222.0.22 () {60 vars in 1148 bytes} [Tue Apr 20 19:00:10 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:10.739213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 19:00:10.743060 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-620806117", "imageRef": "b1180e65-90bf-4bef-b219-de577c16b6bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-91156540", "networks": [{"uuid": "9bc940df-bd8d-441b-ab40-b94c2c2e508a"}]}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:10.975667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] validate_networks() for [('9bc940df-bd8d-441b-ab40-b94c2c2e508a', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:00:11.706776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:00:11.707265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:00:11.707774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:00:11.708281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Image pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:00:11.708750 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:00:11.717689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:11.718184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:11.719167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:11.719661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:11.738806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Getting quotas for project 2ee99eafa14e4e93a5f4a73137557744. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:00:11.754419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Getting quotas for user 72ff5aa8d15840a08503b77cb69c80f6 and project 2ee99eafa14e4e93a5f4a73137557744. Resources: {'cores', 'ram', 'instances'} {{(pid=100569) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:00:11.770043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 46588. Apr 20 19:00:11.772967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Going to run 1 instances... {{(pid=100569) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:00:11.775567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1180e65-90bf-4bef-b219-de577c16b6bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100569) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:00:11.840917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ccd0e70-be12-47b3-8798-bd60fc062c85 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103168 Apr 20 19:00:11.841684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 606/1209] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 19:00:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:00:11.852136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-91288b9c-ac0f-4be4-b4bf-fbc399149d51 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:11.852813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-91288b9c-ac0f-4be4-b4bf-fbc399149d51 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:11.905057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 46596. Apr 20 19:00:12.023285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-91288b9c-ac0f-4be4-b4bf-fbc399149d51 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:12.032213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-91288b9c-ac0f-4be4-b4bf-fbc399149d51 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1256 microversion: 2.1 time: 0.183980 Apr 20 19:00:12.032917 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 604/1210] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:11 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1256 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:13.054947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:13.055692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:13.064429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:13.064874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:13.065722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:13.066214 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:13.190559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:13.199649 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-930958dd-043e-4ce2-8bbd-fb9003bc5e57 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1308 microversion: 2.1 time: 0.151605 Apr 20 19:00:13.200515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 607/1211] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:13 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:14.219872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:14.221314 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:14.235624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:14.236335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:14.237362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:14.238028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:14.589923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:14.604031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a99a6b3a-c3ee-4a50-908b-72cdbbb6e684 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.388519 Apr 20 19:00:14.605796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 605/1212] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:14 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:15.624598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:15.625426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:15.633380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:15.633908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:15.634787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:15.637804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:15.870918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:15.883136 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fa7e6f7d-7d2e-4869-98d7-247b4ae26901 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.262583 Apr 20 19:00:15.884667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 608/1213] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:15 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:16.903721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:16.904316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:16.912594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:16.913100 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:16.913955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:16.914443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:17.155388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:17.165241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-553956e0-97c5-4d3a-a1ee-bfd281ed4118 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.266808 Apr 20 19:00:17.165875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 606/1214] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:16 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:18.184596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:18.185260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:18.193171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:18.193673 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:18.194612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:18.195105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:18.426706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:18.437135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cbe26860-dd89-48e0-b908-3e13f1fa6881 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.257009 Apr 20 19:00:18.438016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 609/1215] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:18 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:19.456305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:19.457219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:19.466803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:19.467304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:19.468135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:19.468623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:19.714235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:19.723336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cd35fc97-d919-47c8-adc6-ff6a3fb95f1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.271472 Apr 20 19:00:19.723950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 607/1216] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:19 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:00:20.742094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:20.743516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:20.751943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:20.752602 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:20.753579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:20.754114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:20.983947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:20.993020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b98c61b-8d26-4427-9557-c3ff3e3cefcd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.255466 Apr 20 19:00:20.993636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 610/1217] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:20 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:22.011553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:22.012903 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:22.023667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:22.024678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:22.026052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:22.026599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:22.266098 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:22.275441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-49772715-f38f-488c-b36e-ec288b0745f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.268184 Apr 20 19:00:22.276664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 608/1218] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:22 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:23.295328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:23.296800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:23.305066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:23.305582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:23.307091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:23.307559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:23.559234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:23.573733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d0a066a8-972a-4c0f-ae37-34fee17b3abe tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.282955 Apr 20 19:00:23.584582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 611/1219] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:23 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:24.596760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:24.597624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:24.607406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:24.608016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:24.608974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:24.609553 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:24.867589 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:24.876493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-abb2b10d-f478-41e7-b611-9b9e07a90472 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.284873 Apr 20 19:00:24.877101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 609/1220] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:24 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:25.895057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:25.896828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:25.906951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:25.907642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:25.908475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:25.908970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:26.137216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:26.148133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b35bdb57-0774-420f-a4e7-416390346b05 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.257414 Apr 20 19:00:26.158670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 612/1221] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:25 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:26.220952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-833bdf70-8754-468e-a770-7738bc8fbddf req-70ed758f-3c84-4d21-b748-d8c8cc4422dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:26.222793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:00:26.222793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:00:26.233442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-833bdf70-8754-468e-a770-7738bc8fbddf req-70ed758f-3c84-4d21-b748-d8c8cc4422dd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:26.235533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-833bdf70-8754-468e-a770-7738bc8fbddf req-70ed758f-3c84-4d21-b748-d8c8cc4422dd service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:26.260361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-833bdf70-8754-468e-a770-7738bc8fbddf req-70ed758f-3c84-4d21-b748-d8c8cc4422dd service nova] Creating event network-changed:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:00:26.268220 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-833bdf70-8754-468e-a770-7738bc8fbddf req-70ed758f-3c84-4d21-b748-d8c8cc4422dd service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129705 Apr 20 19:00:26.269428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 610/1222] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:00:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:00:27.167966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:27.169069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:27.177087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:27.177848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:27.178913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:27.179568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:27.437250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:27.446070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e8795171-7e4c-430c-8bb5-042a1938001f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.282220 Apr 20 19:00:27.446717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 613/1223] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:27 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:28.474824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:28.475737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:28.484076 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:28.484499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:28.485380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:28.485977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:28.705246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:28.714344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-25abe0fe-1e11-4b0b-8f45-8d3118f2f3f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.252721 Apr 20 19:00:28.715006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 611/1224] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:28 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:29.732672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:29.733337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:29.741249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:29.741751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:29.742610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:29.743105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:29.955008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:29.964536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f6b5cdf1-b3c6-45cb-9706-b76517f04527 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.235900 Apr 20 19:00:29.965155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 614/1225] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:29 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:30.983377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:30.984044 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:30.992017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:30.992524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:30.993551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:30.994043 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:31.203918 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:31.212697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d35b3642-73b2-4120-98f9-08ddf904b6dd tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.234118 Apr 20 19:00:31.213891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 612/1226] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:30 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:32.232279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:32.232956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:32.240823 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:32.241330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:32.242162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:32.242778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:32.463192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:32.472034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e169bad3-0392-4d74-90c2-e5d15802dd07 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.244373 Apr 20 19:00:32.472650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 615/1227] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:32 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:00:33.491155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:33.491805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:33.499651 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:33.500149 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:33.500978 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:33.501467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:33.758114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:33.768914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dbcf11fd-365a-42f4-a681-2d6ce95dfb61 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.281931 Apr 20 19:00:33.769640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 613/1228] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:33 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:34.788547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:34.790089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:34.801824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:34.802990 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:34.803992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:34.804708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:35.023818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:35.033492 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-493a1e1b-7f14-4a7d-a445-94020a422756 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.249083 Apr 20 19:00:35.034341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 616/1229] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:34 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:00:35.768914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-ab0ea56e-dab4-4bd5-8057-e17d34c77811 req-1f5e13c7-08a1-4ef1-ae09-3fd46bfbcdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "name": "network-vif-plugged", "status": "completed", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:35.770635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:00:35.770635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:00:35.780248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ab0ea56e-dab4-4bd5-8057-e17d34c77811 req-1f5e13c7-08a1-4ef1-ae09-3fd46bfbcdfa service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:35.780732 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ab0ea56e-dab4-4bd5-8057-e17d34c77811 req-1f5e13c7-08a1-4ef1-ae09-3fd46bfbcdfa service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:35.800438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-ab0ea56e-dab4-4bd5-8057-e17d34c77811 req-1f5e13c7-08a1-4ef1-ae09-3fd46bfbcdfa service nova] Creating event network-vif-plugged:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:00:35.806634 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-ab0ea56e-dab4-4bd5-8057-e17d34c77811 req-1f5e13c7-08a1-4ef1-ae09-3fd46bfbcdfa service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101120 Apr 20 19:00:35.807272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 614/1230] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:00:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:00:36.052058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:36.052828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:36.061235 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:36.061987 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:36.062933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:36.063515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:36.287863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:36.298262 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-27f9ec41-8c0e-4c9f-a17b-22f9b756c918 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1356 microversion: 2.1 time: 0.250528 Apr 20 19:00:36.299757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 617/1231] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:36 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:37.318190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:37.319012 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:37.327964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:37.328465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:37.329326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:37.329811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:37.556994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:37.566192 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a494d019-5268-4ade-8731-4d2bb1f09943 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1545 microversion: 2.1 time: 0.252820 Apr 20 19:00:37.566832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 615/1232] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:37 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1545 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:37.584760 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:37.585423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:37.593233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:37.593730 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:37.594574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:37.595059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:38.054134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:38.063676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c17f854d-bd41-4b06-b528-be7c21838614 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1545 microversion: 2.1 time: 0.482987 Apr 20 19:00:38.064290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 618/1233] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:37 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1545 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:38.080763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:38.084453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:00:38.084453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:00:38.085565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:38.086382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Searching by: {'deleted': False, 'project_id': '2ee99eafa14e4e93a5f4a73137557744'} {{(pid=100570) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 20 19:00:38.092222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:38.092728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:38.093598 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:38.094087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:38.194834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.multi_cell_list [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 20 19:00:38.292582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2e8167a8-b5c4-4413-9367-8cc90da2172f tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215706 Apr 20 19:00:38.293213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 616/1234] 10.222.0.22 () {58 vars in 1115 bytes} [Tue Apr 20 19:00:38 2021] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:00:38.304353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:38.304968 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:38.312828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:38.313334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:38.314168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:38.314717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:38.528369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:38.537351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8f6f3a7c-52ad-4490-a0f5-1e3d84fbaa1d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1545 microversion: 2.1 time: 0.237208 Apr 20 19:00:38.537962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 619/1235] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:38 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1545 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:40.402665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af68aaf7-b648-4db4-8f24-dd81139182e6"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:40.403859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:40.411770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:40.412284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:40.413129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:40.413624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:40.863311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1a5a24b2-5539-4a7d-9441-17cc2cc8ce3d tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464842 Apr 20 19:00:40.864400 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 617/1236] 10.222.0.22 () {60 vars in 1313 bytes} [Tue Apr 20 19:00:40 2021] POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:00:48.939692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:48.940408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:48.949592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:48.950097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:48.951011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:48.951497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:49.164363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:49.173738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d0f4720a-3d11-400a-bc4a-79aa3b2baaa3 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1591 microversion: 2.1 time: 0.238425 Apr 20 19:00:49.174351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 620/1237] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:48 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1591 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:00:50.409386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:00:50.410027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:00:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:00:51.953840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-0837f741-fb2a-4d4a-b7d3-7aa950d5a1e1 req-840c7209-9b40-4962-ae0a-8b9dce8cb555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:51.955894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:00:51.955894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:00:51.966700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0837f741-fb2a-4d4a-b7d3-7aa950d5a1e1 req-840c7209-9b40-4962-ae0a-8b9dce8cb555 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:51.967366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0837f741-fb2a-4d4a-b7d3-7aa950d5a1e1 req-840c7209-9b40-4962-ae0a-8b9dce8cb555 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:51.985779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-0837f741-fb2a-4d4a-b7d3-7aa950d5a1e1 req-840c7209-9b40-4962-ae0a-8b9dce8cb555 service nova] Creating event network-changed:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:00:51.992767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-0837f741-fb2a-4d4a-b7d3-7aa950d5a1e1 req-840c7209-9b40-4962-ae0a-8b9dce8cb555 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216351 Apr 20 19:00:51.993941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 618/1238] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:00:53.027227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-578273113"}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:53.027813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:53.035940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:53.036949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:53.038034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:53.038543 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:53.488028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.network.security_group_api [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Adding security group 36b0341e-68d9-447e-ad2e-7e850dbe1c73 to port 96b88fb9-1c31-4641-9cf7-537fe3914ab5 Apr 20 19:00:54.039922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8d3a0223-7cb9-47b8-b183-1ca4cc5bdeb9 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/action" status: 202 len: 0 microversion: 2.1 time: 1.016698 Apr 20 19:00:54.040554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 621/1239] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 19:00:53 2021] POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:00:54.051169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:00:54.052346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:00:54.056897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-4f2ff995-5277-4bd8-8910-8c14f04f9513 req-4bc5da2c-eb64-43ec-8592-ae9a59937205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:00:54.060879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:00:54.060879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:00:54.062621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:54.063131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:54.063984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:54.064473 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:54.080424 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-4f2ff995-5277-4bd8-8910-8c14f04f9513 req-4bc5da2c-eb64-43ec-8592-ae9a59937205 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:00:54.081544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-4f2ff995-5277-4bd8-8910-8c14f04f9513 req-4bc5da2c-eb64-43ec-8592-ae9a59937205 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:00:54.116236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-4f2ff995-5277-4bd8-8910-8c14f04f9513 req-4bc5da2c-eb64-43ec-8592-ae9a59937205 service nova] Creating event network-changed:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:00:54.122216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-4f2ff995-5277-4bd8-8910-8c14f04f9513 req-4bc5da2c-eb64-43ec-8592-ae9a59937205 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077107 Apr 20 19:00:54.122894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 619/1240] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:00:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:00:54.307795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:00:54.317338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4b80b499-f20a-4131-88f2-14cf53c6c4f1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1637 microversion: 2.1 time: 0.272280 Apr 20 19:00:54.317969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 622/1241] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:00:54 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1637 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:12.819507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:01:12.820272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:01:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:01:16.672071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:01:16.701836 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:16.727407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:16.730723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:16.732761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:16.734960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:17.172409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1f779654-5f8e-43e9-9adf-ef3128cab0b1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/action" status: 202 len: 0 microversion: 2.1 time: 0.516945 Apr 20 19:01:17.173459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 620/1242] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 19:01:16 2021] POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:01:17.186930 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:17.189007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:17.226905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:17.227809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:17.229381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:17.230306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:17.861501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:17.898745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3b2e888a-dd8c-4848-b57a-24c2a39b655b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1747 microversion: 2.1 time: 0.719207 Apr 20 19:01:17.900428 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 623/1243] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:17 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1747 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:18.918335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:18.919133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:18.927507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:18.928007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:18.928845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:18.929332 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:19.657128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:19.667957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8fe3de53-e3dc-4153-aecb-94e1ec834a63 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1747 microversion: 2.1 time: 0.754011 Apr 20 19:01:19.669120 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 621/1244] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:18 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1747 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:20.688217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:20.688895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:20.697212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:20.697716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:20.698621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:20.699187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:20.938657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:20.966254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6bb4948b-ec82-43cc-8aaf-385dc8c2739a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1747 microversion: 2.1 time: 0.266740 Apr 20 19:01:20.967409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 624/1245] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:20 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1747 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:21.520874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7799e971-09a9-4abe-b260-cfde69999176 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Action: 'create', calling method: .version_select at 0x7f1a1d3c29d8>, body: {"keypair": {"name": "tempest-TestShelveInstance-978929302"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:01:21.544869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-7799e971-09a9-4abe-b260-cfde69999176 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Getting quotas for project 58376bdbb5e446aba6e8e644902c36f4. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:01:21.549244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-7799e971-09a9-4abe-b260-cfde69999176 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Getting quotas for user 08e08eada99f49f99272e75a5fcb2b11 and project 58376bdbb5e446aba6e8e644902c36f4. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:01:21.692893 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-7799e971-09a9-4abe-b260-cfde69999176 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Getting quotas for project 58376bdbb5e446aba6e8e644902c36f4. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:01:21.697075 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-7799e971-09a9-4abe-b260-cfde69999176 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Getting quotas for user 08e08eada99f49f99272e75a5fcb2b11 and project 58376bdbb5e446aba6e8e644902c36f4. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:01:21.711254 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7799e971-09a9-4abe-b260-cfde69999176 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.416763 Apr 20 19:01:21.712181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 622/1246] 10.222.0.22 () {60 vars in 1148 bytes} [Tue Apr 20 19:01:21 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:21.986325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:21.987034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:21.995051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:21.995571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:21.996399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:21.996888 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:22.270033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:22.280145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-28305d18-580d-44f5-9353-a578ab58f47c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.298393 Apr 20 19:01:22.281061 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 625/1247] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:21 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:23.309355 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:23.310906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:23.324072 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:23.324550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:23.325635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:23.326103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:23.652717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:23.674297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-87d77213-c7cc-41c1-9a7c-dd29cb6f40c7 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.368936 Apr 20 19:01:23.675399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 623/1248] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:23 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:24.703898 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:24.704582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:24.713113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:24.713621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:24.714535 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:24.715119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:24.965925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:24.979441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-16cab360-4520-48d4-8cda-fa7b5dee6d14 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.279495 Apr 20 19:01:24.980205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 626/1249] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:24 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:26.005468 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:26.006151 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:26.014391 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:26.014960 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:26.015814 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:26.016312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:26.253847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:26.275574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-960e1d57-d532-47a1-8ee2-b6f98ffbcb1a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.274130 Apr 20 19:01:26.276503 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 624/1250] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:25 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:27.297738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:27.298426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:27.306353 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:27.307189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:27.307761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:27.308252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:27.580392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:27.590483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3374b3cf-c8ad-485b-b331-ef3c2edc1477 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.297316 Apr 20 19:01:27.591095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 627/1251] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:27 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:28.610077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:28.610790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:28.618744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:28.619255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:28.620096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:28.620579 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:28.880183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:28.890450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8b70e6a2-b2ea-4e54-b761-0467b13f3f6a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.284976 Apr 20 19:01:28.891111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 625/1252] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:28 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:29.909292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:29.910082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:29.918191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:29.918885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:29.919741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:29.920238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:30.151455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:30.161555 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b8d3393b-fc38-4dba-b740-4773fcacefd1 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.256383 Apr 20 19:01:30.162290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 628/1253] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:29 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:31.181008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:31.181657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:31.189703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:31.190475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:31.191395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:31.191884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:31.425050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:31.434652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c44cb448-05d5-4f4d-9b2b-0199c3aecfd8 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.257824 Apr 20 19:01:31.435272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 626/1254] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:31 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:32.453947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:32.454644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:32.462860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:32.463375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:32.464227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:32.464721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:32.685325 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:32.695119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-806dc594-b14d-44f4-b330-712eee850b34 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.245408 Apr 20 19:01:32.695738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 629/1255] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:32 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:33.713393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:33.714152 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:33.722153 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:33.722707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:33.723563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:33.724066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:33.975573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:33.985804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0825703a-bf27-4d21-a788-01dc194a7eda tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.276499 Apr 20 19:01:33.986435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 627/1256] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:33 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:35.005170 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:35.005834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:35.014610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:35.015112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:35.015946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:35.016435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:35.254646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:35.265162 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f96cb3d2-73d4-4533-9652-1429f05c71ad tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.264025 Apr 20 19:01:35.265783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 630/1257] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:34 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:36.284173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:36.284849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:36.292943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:36.293453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:36.294806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:36.295317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:36.515252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:36.524774 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0e5eb6b7-7ee3-48f8-9714-7cea131ff98a tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1752 microversion: 2.1 time: 0.245109 Apr 20 19:01:36.525402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 628/1258] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:36 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:37.543862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:37.545058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:37.553009 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:37.553510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:37.554343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:37.554856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:37.776010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:37.785672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7b2a0367-d529-47bc-a401-d76b64493ddb tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1755 microversion: 2.1 time: 0.245827 Apr 20 19:01:37.786303 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 631/1259] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:37 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:41.847129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-378621569", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-978929302", "security_groups": [{"name": "tempest-secgroup-smoke-499145341"}], "networks": [{"uuid": "290f9d54-0971-46f3-8039-2445c075ae34"}], "block_device_mapping_v2": [{"uuid": "b8532073-0efd-4b81-ae16-31e49ce2a448", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:01:42.047263 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] validate_networks() for [('290f9d54-0971-46f3-8039-2445c075ae34', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:01:42.775015 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:01:42.775401 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:01:42.776027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:01:42.776597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:01:42.777166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:01:42.786816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:42.787429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:42.788386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:42.788991 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:42.808439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Getting quotas for project 58376bdbb5e446aba6e8e644902c36f4. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:01:42.814879 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Getting quotas for user 08e08eada99f49f99272e75a5fcb2b11 and project 58376bdbb5e446aba6e8e644902c36f4. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:01:42.925367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:01:42.927886 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8532073-0efd-4b81-ae16-31e49ce2a448',volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:01:43.116672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-812773e6-b365-4b4b-ab3e-98b2ea3e4e83 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.275556 Apr 20 19:01:43.117382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 629/1260] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 19:01:41 2021] POST /compute/v2.1/servers => generated 405 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:01:43.129002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6a83bca8-f94b-4f45-94f7-d7206a6c7ca5 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:43.129964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6a83bca8-f94b-4f45-94f7-d7206a6c7ca5 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:43.236720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6a83bca8-f94b-4f45-94f7-d7206a6c7ca5 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:43.245343 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6a83bca8-f94b-4f45-94f7-d7206a6c7ca5 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1087 microversion: 2.1 time: 0.120527 Apr 20 19:01:43.245971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 632/1261] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:43 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1087 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:44.268080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:44.269328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:44.279568 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:44.280340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:44.281369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:44.281869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:44.452128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:44.463587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-951e856a-95dc-45ef-a55a-d3d99911cb5f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1193 microversion: 2.1 time: 0.199843 Apr 20 19:01:44.464472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 630/1262] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:44 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1193 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:45.482237 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:45.483296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:45.492261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:45.492864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:45.493731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:45.494230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:45.729574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:45.741206 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a0d9b0be-37c0-456e-9dbb-41a922afca43 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.263563 Apr 20 19:01:45.742117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 633/1263] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:45 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:46.763780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:46.764462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:46.772819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:46.773381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:46.774256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:46.774771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:46.841026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-532456da-5502-435a-834a-e6996e516395 req-5085417f-5c27-43bc-a169-a62c948e34df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:01:46.842861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:01:46.842861 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:01:46.855683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-532456da-5502-435a-834a-e6996e516395 req-5085417f-5c27-43bc-a169-a62c948e34df service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:46.856190 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-532456da-5502-435a-834a-e6996e516395 req-5085417f-5c27-43bc-a169-a62c948e34df service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:46.877482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-532456da-5502-435a-834a-e6996e516395 req-5085417f-5c27-43bc-a169-a62c948e34df service nova] Creating event network-changed:eea22acf-237e-4f43-91ee-7b618e929ef1 for instance f012e5eb-c916-40af-b54d-b803f861cbd1 on hv-cinder-78693 Apr 20 19:01:46.884026 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-532456da-5502-435a-834a-e6996e516395 req-5085417f-5c27-43bc-a169-a62c948e34df service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047709 Apr 20 19:01:46.884705 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 634/1264] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:01:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:01:47.220747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:47.231103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2d92e086-57c0-42ac-85a5-203881186e14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.473789 Apr 20 19:01:47.240558 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 631/1265] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:46 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:48.250811 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:48.251667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:48.259775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:48.260283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:48.261113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:48.261601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:48.482661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:48.497752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-36eed29d-4e21-468f-8672-872efae948ed tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.252160 Apr 20 19:01:48.498393 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 635/1266] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:48 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:49.518095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:49.518803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:49.526710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:49.527855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:49.528686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:49.529185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:49.738402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:49.747995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-804e6126-0402-42c5-824f-88f90c82ffe0 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.233985 Apr 20 19:01:49.748624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 632/1267] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:49 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:50.766808 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:50.767486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:50.775459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:50.775966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:50.776800 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:50.777292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:50.993161 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:51.002696 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f1faedfa-d226-4ecf-9da4-618031100643 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.239965 Apr 20 19:01:51.003315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 636/1268] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:50 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:52.021215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:52.021876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:52.030021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:52.030593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:52.031440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:52.031941 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:52.251244 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:52.260071 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b39495df-b3e3-49e2-ac61-973248adedcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.243012 Apr 20 19:01:52.260694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 633/1269] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:52 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:53.281291 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:53.282274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:53.293757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:53.294508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:53.295728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:53.296440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:53.513584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:53.522646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-67ff86dc-6828-4896-bf7d-d0571c5cc873 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.247013 Apr 20 19:01:53.523279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 637/1270] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:53 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:54.541171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:54.541839 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:54.550315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:54.550954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:54.551797 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:54.552296 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:54.764330 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:54.773348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f5ffa969-c4e8-49a8-a7c2-d9b73c99adcf tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.236724 Apr 20 19:01:54.773969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 634/1271] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:54 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:55.791931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:55.792601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:55.801346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:55.801561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:55.802383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:55.802911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:56.162637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:56.172135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d51374f8-7e0c-4b9b-a69e-bf0675a95935 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.384248 Apr 20 19:01:56.172758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 638/1272] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:55 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:57.190723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:57.191313 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:57.201962 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:57.202707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:57.203928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:57.204633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:57.441819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:57.451312 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7a62166b-38ff-44c7-a1e8-e4205a460222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.265030 Apr 20 19:01:57.451979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 635/1273] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:57 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:57.847715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-9c2237ee-19d6-47c1-aa26-f3745670118a req-1d5111f5-2853-4757-850d-58330c3e117e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "name": "network-vif-plugged", "status": "completed", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:01:57.849527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:01:57.849527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:01:57.859185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9c2237ee-19d6-47c1-aa26-f3745670118a req-1d5111f5-2853-4757-850d-58330c3e117e service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:57.859691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-9c2237ee-19d6-47c1-aa26-f3745670118a req-1d5111f5-2853-4757-850d-58330c3e117e service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:57.877767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-9c2237ee-19d6-47c1-aa26-f3745670118a req-1d5111f5-2853-4757-850d-58330c3e117e service nova] Creating event network-vif-plugged:eea22acf-237e-4f43-91ee-7b618e929ef1 for instance f012e5eb-c916-40af-b54d-b803f861cbd1 on hv-cinder-78693 Apr 20 19:01:57.883014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-9c2237ee-19d6-47c1-aa26-f3745670118a req-1d5111f5-2853-4757-850d-58330c3e117e service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039668 Apr 20 19:01:57.883666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 639/1274] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:01:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:01:58.470225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:58.470972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:58.478920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:58.479420 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:58.480912 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:58.481494 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:58.704215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:58.713430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-81f08c00-a741-485e-b389-627028f80a29 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1258 microversion: 2.1 time: 0.247386 Apr 20 19:01:58.714078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 636/1275] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:58 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:59.734824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:59.735600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:59.743708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:59.744223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:59.745065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:59.746128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:59.957824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:01:59.966873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4bc8dcd8-42be-4fe3-a7ac-d3cb8b8968fe tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1442 microversion: 2.1 time: 0.236598 Apr 20 19:01:59.967491 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 640/1276] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:59 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1442 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:01:59.983881 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:01:59.984571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:01:59.992333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:59.992832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:01:59.993655 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:01:59.994143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:00.209487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:02:00.218693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3a4acca1-7f9e-4737-9556-32415aead179 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1442 microversion: 2.1 time: 0.238749 Apr 20 19:02:00.219319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 637/1277] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:01:59 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1442 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:02:02.898623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-1c0f2816-050f-4d48-9144-09ede063673b req-3b1a2f53-74c2-4e96-a89f-c0c4a1abe162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:02:02.901179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:02:02.901179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:02:02.912395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1c0f2816-050f-4d48-9144-09ede063673b req-3b1a2f53-74c2-4e96-a89f-c0c4a1abe162 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:02.913005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1c0f2816-050f-4d48-9144-09ede063673b req-3b1a2f53-74c2-4e96-a89f-c0c4a1abe162 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:02.934906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-1c0f2816-050f-4d48-9144-09ede063673b req-3b1a2f53-74c2-4e96-a89f-c0c4a1abe162 service nova] Creating event network-changed:eea22acf-237e-4f43-91ee-7b618e929ef1 for instance f012e5eb-c916-40af-b54d-b803f861cbd1 on hv-cinder-78693 Apr 20 19:02:02.941264 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-1c0f2816-050f-4d48-9144-09ede063673b req-3b1a2f53-74c2-4e96-a89f-c0c4a1abe162 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047733 Apr 20 19:02:02.942497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 641/1278] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:02:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:02:10.860872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-578273113"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:02:10.861463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:10.869578 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:10.870089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:10.870966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:10.871464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:11.325175 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.network.security_group_api [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Removing security group 36b0341e-68d9-447e-ad2e-7e850dbe1c73 from port 96b88fb9-1c31-4641-9cf7-537fe3914ab5 Apr 20 19:02:11.837477 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1e235b5b-6181-4a55-ae6f-2f4809e063d6 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/action" status: 202 len: 0 microversion: 2.1 time: 0.980723 Apr 20 19:02:11.838215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 638/1279] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 19:02:10 2021] POST /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/action => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:02:11.853925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-1a0ca3c4-0196-42cc-b75c-4adb7a1b93f6 req-769205c1-f526-4f14-8548-5de83313c98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:02:11.855715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:02:11.855715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:02:11.883433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1a0ca3c4-0196-42cc-b75c-4adb7a1b93f6 req-769205c1-f526-4f14-8548-5de83313c98d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:11.884077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1a0ca3c4-0196-42cc-b75c-4adb7a1b93f6 req-769205c1-f526-4f14-8548-5de83313c98d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:11.911586 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-1a0ca3c4-0196-42cc-b75c-4adb7a1b93f6 req-769205c1-f526-4f14-8548-5de83313c98d service nova] Creating event network-changed:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:02:11.918231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-1a0ca3c4-0196-42cc-b75c-4adb7a1b93f6 req-769205c1-f526-4f14-8548-5de83313c98d service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070816 Apr 20 19:02:11.919463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 642/1280] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:02:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:02:13.992511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-71b692fd-173a-476a-8bad-b9b0ebdd4271 req-30873308-5801-4fc0-bbad-9ec155aa8c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:02:13.994156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:02:13.994156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:02:13.996226 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:13.996771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:14.005430 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:14.006279 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:14.007386 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:14.007899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:14.011292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-71b692fd-173a-476a-8bad-b9b0ebdd4271 req-30873308-5801-4fc0-bbad-9ec155aa8c2b service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:14.011791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-71b692fd-173a-476a-8bad-b9b0ebdd4271 req-30873308-5801-4fc0-bbad-9ec155aa8c2b service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:14.031050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-71b692fd-173a-476a-8bad-b9b0ebdd4271 req-30873308-5801-4fc0-bbad-9ec155aa8c2b service nova] Creating event network-changed:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:02:14.036704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-71b692fd-173a-476a-8bad-b9b0ebdd4271 req-30873308-5801-4fc0-bbad-9ec155aa8c2b service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048615 Apr 20 19:02:14.037629 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 643/1281] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:02:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:02:14.217099 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lazy-loading 'services' on Instance uuid 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:02:14.370944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3fcd9382-4924-4046-b1a4-6d59d5cb17ef tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "DELETE /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments/af68aaf7-b648-4db4-8f24-dd81139182e6" status: 202 len: 0 microversion: 2.1 time: 0.387078 Apr 20 19:02:14.371791 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 639/1282] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 19:02:13 2021] DELETE /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments/af68aaf7-b648-4db4-8f24-dd81139182e6 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:02:14.382894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:14.384443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:14.395544 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:14.396011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:14.396988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:14.397583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:14.471508 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9d6bb707-ecf8-42a9-a7fc-69fe0c1b3766 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094396 Apr 20 19:02:14.472274 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 644/1283] 10.222.0.22 () {58 vars in 1292 bytes} [Tue Apr 20 19:02:14 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:02:15.487345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:15.488570 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:15.498218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:15.498801 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:15.499645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:15.500129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:15.574360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c8fc03d7-d770-4cf5-866c-bcbeed0a50a5 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092465 Apr 20 19:02:15.575021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 640/1284] 10.222.0.22 () {58 vars in 1292 bytes} [Tue Apr 20 19:02:15 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:02:15.585704 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:15.586250 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:15.595003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:15.595542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:15.596406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:15.596892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:15.772998 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] HTTP exception thrown: Instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e is not attached to volume af68aaf7-b648-4db4-8f24-dd81139182e6 Apr 20 19:02:15.773667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Returning 404 to user: Instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e is not attached to volume af68aaf7-b648-4db4-8f24-dd81139182e6 {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:02:15.774624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-46d9dd6a-e716-43b5-8bfb-393a6e054a9b tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "DELETE /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments/af68aaf7-b648-4db4-8f24-dd81139182e6" status: 404 len: 154 microversion: 2.1 time: 0.193226 Apr 20 19:02:15.775224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 645/1285] 10.222.0.22 () {58 vars in 1406 bytes} [Tue Apr 20 19:02:15 2021] DELETE /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e/os-volume_attachments/af68aaf7-b648-4db4-8f24-dd81139182e6 => generated 154 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:02:17.029721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:17.030281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:17.038133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:17.038672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:17.039505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:17.040001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:17.104785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:02:17.223222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-053cb07f-9e41-4529-977c-197a456e9784 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "DELETE /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 204 len: 0 microversion: 2.1 time: 0.197141 Apr 20 19:02:17.223864 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 641/1286] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:02:17 2021] DELETE /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:02:17.233135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:17.233806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:17.241633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:17.242139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:17.243007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:17.243497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:17.494157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:02:17.503796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-aed773c5-998f-4eab-bf3a-2b0ff1742f8c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1551 microversion: 2.1 time: 0.275281 Apr 20 19:02:17.504413 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 646/1287] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:02:17 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1551 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:02:18.522539 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:18.523537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:18.533331 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:18.533708 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:18.534599 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:18.535108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:18.977419 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:02:18.986819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f5061b12-7c89-4239-a102-e7818d2b40ed tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1551 microversion: 2.1 time: 0.468755 Apr 20 19:02:18.987456 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 642/1288] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:02:18 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1551 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:02:20.005581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:20.006255 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:20.014432 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:20.015005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:20.015857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:20.016380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:20.230642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ff5aa8d15840a08503b77cb69c80f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee99eafa14e4e93a5f4a73137557744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:02:20.239638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2817e23c-0bd7-451b-8c5f-93266660387c tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 200 len: 1551 microversion: 2.1 time: 0.238297 Apr 20 19:02:20.240256 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 647/1289] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:02:20 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 1551 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:02:20.374956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-42374add-a650-4c01-93c2-f89dbafe35b0 req-1ecd6d2e-bf48-453f-b8a5-69e169210fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b5877-9ad8-477d-a0d5-f5f619b3d80e", "name": "network-vif-deleted", "tag": "96b88fb9-1c31-4641-9cf7-537fe3914ab5"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:02:20.376644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:02:20.376644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:02:20.386671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-42374add-a650-4c01-93c2-f89dbafe35b0 req-1ecd6d2e-bf48-453f-b8a5-69e169210fdb service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:20.387211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-42374add-a650-4c01-93c2-f89dbafe35b0 req-1ecd6d2e-bf48-453f-b8a5-69e169210fdb service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:20.405122 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-42374add-a650-4c01-93c2-f89dbafe35b0 req-1ecd6d2e-bf48-453f-b8a5-69e169210fdb service nova] Creating event network-vif-deleted:96b88fb9-1c31-4641-9cf7-537fe3914ab5 for instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e on hv-cinder-78693 Apr 20 19:02:20.410711 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-42374add-a650-4c01-93c2-f89dbafe35b0 req-1ecd6d2e-bf48-453f-b8a5-69e169210fdb service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039866 Apr 20 19:02:20.411416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 643/1290] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:02:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:02:21.257815 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:21.258507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] [instance: 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:02:21.266661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:21.267169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:21.268005 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:02:21.268493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:02:21.324176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] HTTP exception thrown: Instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e could not be found. Apr 20 19:02:21.324840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Returning 404 to user: Instance 0c6b5877-9ad8-477d-a0d5-f5f619b3d80e could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:02:21.325733 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-20c706df-eab9-4b34-b66c-465b9edb7d62 tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e" status: 404 len: 111 microversion: 2.1 time: 0.072059 Apr 20 19:02:21.326334 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 648/1291] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:02:21 2021] GET /compute/v2.1/servers/0c6b5877-9ad8-477d-a0d5-f5f619b3d80e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:02:21.336087 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-96cb4b90-07ce-46f8-ae4d-a9510168c0fc tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] Calling method '.version_select at 0x7f1a208e70d0>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:02:21.354818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-96cb4b90-07ce-46f8-ae4d-a9510168c0fc tempest-TestMinimumBasicScenario-1473967000 tempest-TestMinimumBasicScenario-1473967000-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-91156540" status: 202 len: 0 microversion: 2.1 time: 0.022667 Apr 20 19:02:21.355472 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 644/1292] 10.222.0.22 () {58 vars in 1256 bytes} [Tue Apr 20 19:02:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-91156540 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:02:31.933871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:02:31.934426 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:02:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:03:45.624916 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 20 19:03:45.628549 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:45.629647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:45.637683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:45.638189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:45.639084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:45.639578 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:45.693761 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] HTTP exception thrown: Instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e could not be found. Apr 20 19:03:45.694429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Returning 404 to user: Instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:03:45.695380 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7cddcf5d-4bcc-49c1-8efc-fe9750a4ef77 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 404 len: 111 microversion: 2.1 time: 0.071606 Apr 20 19:03:45.695993 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 649/1293] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:03:45 2021] DELETE /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:03:45.704857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:45.705662 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 5fdafac6-0e5f-4d11-a71a-071aaad3f92e] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:45.713925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:45.714431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:45.715304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:45.715787 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:45.769652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] HTTP exception thrown: Instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e could not be found. Apr 20 19:03:45.770323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Returning 404 to user: Instance 5fdafac6-0e5f-4d11-a71a-071aaad3f92e could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:03:45.771342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e465b3f5-f251-44a1-a47f-64424431d5db tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e" status: 404 len: 111 microversion: 2.1 time: 0.070854 Apr 20 19:03:45.771958 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 645/1294] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:03:45 2021] GET /compute/v2.1/servers/5fdafac6-0e5f-4d11-a71a-071aaad3f92e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:03:47.025695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:47.026219 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:47.044862 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:47.045348 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:47.046196 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:47.046721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:47.101095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1f94f75-585c-4479-9166-bfce5cda928e] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 47932. Apr 20 19:03:47.101974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] HTTP exception thrown: Instance 291eea25-3def-4661-bf74-4a540fedde0a could not be found. Apr 20 19:03:47.102674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Returning 404 to user: Instance 291eea25-3def-4661-bf74-4a540fedde0a could not be found. {{(pid=100569) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:03:47.103588 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a4a4e62f-9973-4338-af60-4a6c48c98cd6 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "DELETE /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 404 len: 111 microversion: 2.1 time: 0.082078 Apr 20 19:03:47.104189 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 650/1295] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:03:47 2021] DELETE /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:03:47.112875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:47.113574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] [instance: 291eea25-3def-4661-bf74-4a540fedde0a] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:47.121376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:47.121873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:47.122724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:47.123216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:47.180137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] HTTP exception thrown: Instance 291eea25-3def-4661-bf74-4a540fedde0a could not be found. Apr 20 19:03:47.180795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] Returning 404 to user: Instance 291eea25-3def-4661-bf74-4a540fedde0a could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:03:47.181771 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8efd7b85-9814-49d9-ac40-0df1e9c5a8a8 tempest-AttachVolumeTestJSON-1034308308 tempest-AttachVolumeTestJSON-1034308308-project] 10.222.0.22 "GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a" status: 404 len: 111 microversion: 2.1 time: 0.073068 Apr 20 19:03:47.182363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 646/1296] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:03:47 2021] GET /compute/v2.1/servers/291eea25-3def-4661-bf74-4a540fedde0a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:03:55.266148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:03:55.266788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:55.274606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:55.275119 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:55.275942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:55.276692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:55.348177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lazy-loading 'flavor' on Instance uuid f012e5eb-c916-40af-b54d-b803f861cbd1 {{(pid=100569) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:03:55.496146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f1a60b5e-6a1f-4ae8-8696-71c684400ead tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "POST /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1/action" status: 202 len: 0 microversion: 2.1 time: 0.234233 Apr 20 19:03:55.496793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 651/1297] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 19:03:55 2021] POST /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:03:55.505482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:55.506155 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:55.514821 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:55.515336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:55.516265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:55.516756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:55.745163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:03:55.755375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3515c74e-0233-4a92-9abc-644bd4b15da1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.253969 Apr 20 19:03:55.756007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 647/1298] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:03:55 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:03:56.775272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:56.776058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:56.785006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:56.785636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:56.786616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:56.787229 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:57.022378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:03:57.031522 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9d9b70f6-332a-428f-b7ad-8726def13c11 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.261173 Apr 20 19:03:57.032038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 652/1299] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:03:56 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:03:58.049253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:58.050537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:58.058796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:58.059306 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:58.060177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:58.060663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:58.286858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:03:58.296737 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e5bc06b6-2c68-449e-b223-3a7d08fd9a8f tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.251371 Apr 20 19:03:58.297390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 648/1300] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:03:58 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:03:59.317581 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:03:59.318260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:03:59.326260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:59.326816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:59.327658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:03:59.328145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:03:59.543429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:03:59.553113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-554d3f58-96de-4fab-bf95-82e0bceec389 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.240179 Apr 20 19:03:59.553728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 653/1301] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:03:59 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:00.571896 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:00.572561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:00.581133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:00.581648 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:00.582512 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:00.583020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:00.801317 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:00.810721 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-911df707-173b-4ffe-a2bd-4f042b812254 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.242844 Apr 20 19:04:00.811336 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 649/1302] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:00 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:01.829550 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:01.830239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:01.839169 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:01.839542 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:01.840246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:01.840744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:02.062970 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:02.072487 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7915ef54-b34d-470c-a3a8-752e47280222 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.247070 Apr 20 19:04:02.073116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 654/1303] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:01 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:03.091533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:03.092141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:03.100633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:03.101131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:03.101949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:03.102438 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:03.314094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:03.323258 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fd680122-59f4-4c91-a029-99c54ff54fc6 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.235771 Apr 20 19:04:03.330845 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 650/1304] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:03 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:04:04.342037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:04.342740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:04.351288 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:04.351792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:04.352622 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:04.353112 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:04.566001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:04.574946 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-94166e08-5430-4395-ae0a-cca8a037f6b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.237529 Apr 20 19:04:04.575565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 655/1305] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:04 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:05.599213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:05.599213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:05.602718 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:05.603222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:05.604051 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:05.604603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:05.873404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:05.882616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7ba0efc7-a52c-42c6-b19b-c2142fb41155 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.293082 Apr 20 19:04:05.883245 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 651/1306] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:05 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:06.901848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:06.902640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:06.910631 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:06.911144 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:06.912025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:06.912518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:07.142280 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:07.151425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b0fb20d1-e7af-46f8-8de1-25f089243682 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.254642 Apr 20 19:04:07.152139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 656/1307] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:06 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:08.169304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:08.169974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:08.178243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:08.178773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:08.179610 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:08.180108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:08.413321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:08.422744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3d17a8f0-0ea3-455a-815c-8a451056c930 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.257257 Apr 20 19:04:08.423615 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 652/1308] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:08 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:09.441601 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:09.442309 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:09.450299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:09.450834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:09.451661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:09.452146 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:09.669504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:09.678865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8105396d-5500-4931-9111-67811eaea2e7 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1567 microversion: 2.1 time: 0.241338 Apr 20 19:04:09.679604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 657/1309] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:09 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:09.696659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:04:09.697359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:09.705266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:09.705767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:09.710450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:09.710450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:09.868021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [b3ca497f-5f0a-4965-b152-d6a956d8b2cf] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 19:04:10.885767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [b3ca497f-5f0a-4965-b152-d6a956d8b2cf] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 48200. Apr 20 19:04:10.889135 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f38e8687-57a8-4d70-944a-f699e0aa676d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "POST /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1/action" status: 202 len: 0 microversion: 2.1 time: 1.196764 Apr 20 19:04:10.893499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 653/1310] 10.222.0.22 () {60 vars in 1268 bytes} [Tue Apr 20 19:04:09 2021] POST /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1/action => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:04:10.899184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:10.899740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:10.912451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:10.912451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:10.912451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:10.912451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:11.221688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:11.231830 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-095354c2-6471-4123-9547-b94c831e0fd9 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1515 microversion: 2.1 time: 0.337041 Apr 20 19:04:11.232857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 658/1311] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:10 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:04:12.253635 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:12.254318 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:12.258776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:04:12.264894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:12.265459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:12.266315 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:12.266847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:12.494858 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-0c2d8347-46b9-495e-9442-c568490ed242 req-61e01727-d274-4a93-ae3a-3816c1748511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "name": "network-vif-unplugged", "status": "completed", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:04:12.497346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:04:12.497346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:04:12.504078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:12.514661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-cd047b43-2649-48b9-bf52-1b6640b46942 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1515 microversion: 2.1 time: 0.265068 Apr 20 19:04:12.517519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 654/1312] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:12 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:12.522437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0c2d8347-46b9-495e-9442-c568490ed242 req-61e01727-d274-4a93-ae3a-3816c1748511 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:12.523137 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0c2d8347-46b9-495e-9442-c568490ed242 req-61e01727-d274-4a93-ae3a-3816c1748511 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:12.541566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.compute.server_external_events [req-0c2d8347-46b9-495e-9442-c568490ed242 req-61e01727-d274-4a93-ae3a-3816c1748511 service nova] Unable to find a host for instance f012e5eb-c916-40af-b54d-b803f861cbd1. Dropping event network-vif-unplugged {{(pid=100569) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 19:04:12.542575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-0c2d8347-46b9-495e-9442-c568490ed242 req-61e01727-d274-4a93-ae3a-3816c1748511 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052173 Apr 20 19:04:12.543454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 659/1313] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:04:12 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 20 19:04:13.537752 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:13.538973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:13.562883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 48280. Apr 20 19:04:13.572384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:13.572885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:13.573739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:13.574560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:13.823113 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:13.833441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-39c30558-9516-42ca-9e9e-44610696a924 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1515 microversion: 2.1 time: 0.299752 Apr 20 19:04:13.834056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 655/1314] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:13 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:14.852959 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:14.854014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:14.862360 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:14.863095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:14.865114 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:14.865701 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:15.117466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:15.126745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-06e7810b-dbd2-4ef2-9477-1b0595191886 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1517 microversion: 2.1 time: 0.278452 Apr 20 19:04:15.127552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 660/1315] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:14 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1517 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:16.145252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:16.145923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:16.153794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:16.154302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:16.155173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:16.155665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:16.381238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:16.390058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f521e0ed-bf23-4ae9-bdd5-74ff36590621 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.248970 Apr 20 19:04:16.390697 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 656/1316] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:16 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:17.408806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:17.409475 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:17.418046 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:17.418406 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:17.419271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:17.419756 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:17.634751 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:17.643939 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fea78ecc-6914-4311-b024-e3dfb67c07a1 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.239258 Apr 20 19:04:17.644556 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 661/1317] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:17 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:18.662109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:18.662954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:18.671616 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:18.672266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:18.673227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:18.673807 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:19.154395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:19.163863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f4d9ef8-5ab7-4ddc-9521-6d2163d3b552 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.506224 Apr 20 19:04:19.164482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 657/1318] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:18 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:20.182222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:20.182921 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:20.190757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:20.191304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:20.192142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:20.192633 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:20.418260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:20.430439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f51afd6b-c6ec-4d75-b8a3-de24f2351798 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.252057 Apr 20 19:04:20.431176 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 662/1319] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:20 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:21.449974 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:21.450726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:21.458695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:21.459205 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:21.460640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:21.461143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:21.684157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:21.693107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a2bba82c-6452-4e8f-ae18-4f1465933c14 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.247242 Apr 20 19:04:21.693716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 658/1320] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:21 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:22.712720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:22.713520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:22.721533 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:22.722022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:22.722883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:22.723375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:22.945444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:22.954481 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d0203c7-82b2-4990-9fcd-5776d1a2e948 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.246424 Apr 20 19:04:22.955230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 663/1321] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:22 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:23.973571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:23.974236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:23.982160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:23.982699 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:23.983519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:23.984007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:24.193832 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:24.203267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-291fd5ce-2912-4945-af1a-8076bf636896 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.233916 Apr 20 19:04:24.203882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 659/1322] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:23 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:25.147966 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:04:25.148804 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:04:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:04:25.222077 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:25.222780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:25.231698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:25.232210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:25.233070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:25.233574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:25.460117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:25.469124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7846f9de-72b3-49da-9db6-d08ca8283c9d tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.251590 Apr 20 19:04:25.469957 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 664/1323] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:25 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:26.489311 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:26.489986 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:26.502950 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:26.503452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:26.504300 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:26.504835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:26.592341 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-63cc2014-c13f-47da-970b-fcf270d0f8ef req-3e29ad00-09dd-4add-886c-d57b61288990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "name": "network-vif-plugged", "status": "completed", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:04:26.595749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:04:26.595749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:04:26.606686 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-63cc2014-c13f-47da-970b-fcf270d0f8ef req-3e29ad00-09dd-4add-886c-d57b61288990 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:26.607435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-63cc2014-c13f-47da-970b-fcf270d0f8ef req-3e29ad00-09dd-4add-886c-d57b61288990 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:26.627764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-63cc2014-c13f-47da-970b-fcf270d0f8ef req-3e29ad00-09dd-4add-886c-d57b61288990 service nova] Creating event network-vif-plugged:eea22acf-237e-4f43-91ee-7b618e929ef1 for instance f012e5eb-c916-40af-b54d-b803f861cbd1 on hv-cinder-78693 Apr 20 19:04:26.635008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-63cc2014-c13f-47da-970b-fcf270d0f8ef req-3e29ad00-09dd-4add-886c-d57b61288990 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046456 Apr 20 19:04:26.636216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 665/1324] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:04:26.743583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:26.753340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-93cf5b5b-5c9b-45ec-92d4-5b502c6c58b2 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.269129 Apr 20 19:04:26.764668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 660/1325] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:26 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:27.772134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:27.772911 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100569) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:27.781097 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:27.781646 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:27.782531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:27.783008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100569) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:27.874639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:04:27.874816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:04:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:04:28.005041 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100569) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:28.014495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8b94e737-fd67-4866-9b4f-856afafaf707 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1573 microversion: 2.1 time: 0.247051 Apr 20 19:04:28.015143 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100569|app: 0|req: 666/1326] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:27 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:29.033403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:04:29.034045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:04:29.042116 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:29.042656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:29.043562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:04:29.043951 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:04:29.264776 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:04:29.273689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6bb20990-bf38-49c0-b5e4-cdf055190e88 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1560 microversion: 2.1 time: 0.244334 Apr 20 19:04:29.274305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 661/1327] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:04:29 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:04:32.226382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ce41e494-ea93-4a2f-bb41-18e0e0ac66c4 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1665600254", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "9d75aaea-9223-4649-aed2-cd4ebfc8eb93"}]}} {{(pid=100569) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:04:32.296904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-ce41e494-ea93-4a2f-bb41-18e0e0ac66c4 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] validate_networks() for [('9d75aaea-9223-4649-aed2-cd4ebfc8eb93', None, None, None)] {{(pid=100569) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:04:32.836871 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-ce41e494-ea93-4a2f-bb41-18e0e0ac66c4 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Flavor limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:04:32.837351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-ce41e494-ea93-4a2f-bb41-18e0e0ac66c4 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Image limits 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:04:32.837913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-ce41e494-ea93-4a2f-bb41-18e0e0ac66c4 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Flavor pref 0:0:0 {{(pid=100569) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:04:32.839541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Traceback (most recent call last): Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: timer() Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: cb(*args, **kw) Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: File "/usr/local/lib/python3.6/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: waiter.switch() Apr 20 19:04:32.839695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: greenlet.error: cannot switch to a different thread Apr 20 19:05:32.319527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-348431145", "imageRef": "277f1c43-a88d-4ff3-ac02-f785097a9f28", "flavorRef": "452", "networks": [{"uuid": "9d75aaea-9223-4649-aed2-cd4ebfc8eb93"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:05:32.566444 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] validate_networks() for [('9d75aaea-9223-4649-aed2-cd4ebfc8eb93', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:05:33.090767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:05:33.091290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:05:33.091829 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:05:33.092284 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:05:33.092744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:05:33.102628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:33.103132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:33.104007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:33.104496 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:33.123212 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Getting quotas for project 7ad9ae30e0734ba0bda347abdaa58bc0. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:05:33.127999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Getting quotas for user 1554d184d03045f2ba54b1abb3ab118b and project 7ad9ae30e0734ba0bda347abdaa58bc0. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:05:33.139017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:05:33.141592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='277f1c43-a88d-4ff3-ac02-f785097a9f28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:05:33.193485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-8e2b2115-aaab-4872-9776-9d5a7c77cfc6 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878146 Apr 20 19:05:33.194210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 662/1328] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 19:05:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:05:33.205023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-64f23e41-0ad8-4fcd-a62c-f347c37fe9ce tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:33.205736 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-64f23e41-0ad8-4fcd-a62c-f347c37fe9ce tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:33.290287 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-64f23e41-0ad8-4fcd-a62c-f347c37fe9ce tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:33.300052 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-64f23e41-0ad8-4fcd-a62c-f347c37fe9ce tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1213 microversion: 2.1 time: 0.099119 Apr 20 19:05:33.300676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 663/1329] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:33 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:34.318536 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-581f36c4-556f-45e6-a3de-6cccf7a7b077 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:34.319216 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-581f36c4-556f-45e6-a3de-6cccf7a7b077 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:34.398851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-581f36c4-556f-45e6-a3de-6cccf7a7b077 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:34.406961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-581f36c4-556f-45e6-a3de-6cccf7a7b077 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1213 microversion: 2.1 time: 0.092503 Apr 20 19:05:34.408217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 664/1330] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:34 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:35.427094 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4892cde9-c7d4-4349-90ca-4df17e89b482 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:35.427764 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4892cde9-c7d4-4349-90ca-4df17e89b482 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:35.505439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4892cde9-c7d4-4349-90ca-4df17e89b482 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:35.514030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4892cde9-c7d4-4349-90ca-4df17e89b482 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1213 microversion: 2.1 time: 0.091799 Apr 20 19:05:35.514712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 665/1331] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:35 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:36.531459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:36.532158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:36.541134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:36.541642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:36.542739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:36.543236 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:36.700882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:36.710147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fbd8d056-7dcb-4710-b294-e809de32e500 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1273 microversion: 2.1 time: 0.182722 Apr 20 19:05:36.710999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 666/1332] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:36 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:37.728603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:37.729289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:37.737726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:37.738225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:37.739101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:37.739583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:38.187813 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:38.196712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2dffd1ab-ae20-420b-ae95-7b5835d6e4c7 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1313 microversion: 2.1 time: 0.472255 Apr 20 19:05:38.197366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 667/1333] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:37 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:39.026726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-b16db97f-b52a-4c5e-81f6-108024cced02 req-c2804ae1-dd1c-438b-9e0e-bb94933029a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4394c1a1-5a8c-4259-b894-e90109dade42", "tag": "39c71437-51d9-4359-8ec6-61d53e9484f0"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:05:39.028490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:05:39.028490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:05:39.038011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b16db97f-b52a-4c5e-81f6-108024cced02 req-c2804ae1-dd1c-438b-9e0e-bb94933029a5 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:39.038525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-b16db97f-b52a-4c5e-81f6-108024cced02 req-c2804ae1-dd1c-438b-9e0e-bb94933029a5 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:39.055940 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-b16db97f-b52a-4c5e-81f6-108024cced02 req-c2804ae1-dd1c-438b-9e0e-bb94933029a5 service nova] Creating event network-changed:39c71437-51d9-4359-8ec6-61d53e9484f0 for instance 4394c1a1-5a8c-4259-b894-e90109dade42 on hv-cinder-78693 Apr 20 19:05:39.061964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-b16db97f-b52a-4c5e-81f6-108024cced02 req-c2804ae1-dd1c-438b-9e0e-bb94933029a5 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103953 Apr 20 19:05:39.062923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 668/1334] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:05:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:05:39.216437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:39.217125 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:39.225722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:39.226225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:39.227115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:39.227608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:39.655582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:39.666979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2bdadd3e-07e1-427b-8565-c6e9e0e1063e tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1313 microversion: 2.1 time: 0.455092 Apr 20 19:05:39.667608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 669/1335] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:39 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:40.686246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:40.686246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:40.695768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:40.696408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:40.697933 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:40.698853 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:41.003720 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:41.012621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-18f9dedb-b06a-47bd-8f95-f985e1b83f7c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1313 microversion: 2.1 time: 0.331338 Apr 20 19:05:41.013238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 670/1336] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:40 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:42.031037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:42.032266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:42.040117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:42.040624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:42.041476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:42.041963 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:42.252920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:42.261667 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e9297ece-fbaa-4e82-b9f7-11db2adef176 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1313 microversion: 2.1 time: 0.234730 Apr 20 19:05:42.262273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 671/1337] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:42 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:43.013757 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-a746591f-3a0f-4fab-b3cf-ea245543cb48 req-69438184-b764-408c-a531-f0ccd2184046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4394c1a1-5a8c-4259-b894-e90109dade42", "name": "network-vif-plugged", "status": "completed", "tag": "39c71437-51d9-4359-8ec6-61d53e9484f0"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:05:43.015489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:05:43.015489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:05:43.025382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-a746591f-3a0f-4fab-b3cf-ea245543cb48 req-69438184-b764-408c-a531-f0ccd2184046 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:43.025894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-a746591f-3a0f-4fab-b3cf-ea245543cb48 req-69438184-b764-408c-a531-f0ccd2184046 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:43.044971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-a746591f-3a0f-4fab-b3cf-ea245543cb48 req-69438184-b764-408c-a531-f0ccd2184046 service nova] Creating event network-vif-plugged:39c71437-51d9-4359-8ec6-61d53e9484f0 for instance 4394c1a1-5a8c-4259-b894-e90109dade42 on hv-cinder-78693 Apr 20 19:05:43.051217 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-a746591f-3a0f-4fab-b3cf-ea245543cb48 req-69438184-b764-408c-a531-f0ccd2184046 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101549 Apr 20 19:05:43.051873 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 672/1338] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:05:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:05:43.280148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:43.280964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:43.289856 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:43.290361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:43.291243 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:43.291746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:43.522738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:43.531702 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-486c5509-2ac8-4a25-8804-b74d36679e59 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1313 microversion: 2.1 time: 0.256001 Apr 20 19:05:43.532267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 673/1339] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:43 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:44.550530 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:44.551105 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:44.558934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:44.559439 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:44.560268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:44.560762 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:44.772885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:44.781834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-dcccd3df-ac3b-4cc8-8374-46bfb081fc2d tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1496 microversion: 2.1 time: 0.236363 Apr 20 19:05:44.782454 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 674/1340] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:44 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1496 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:45.675033 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:45.675559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:45.683863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:45.684375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:45.685234 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:45.685792 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:45.756518 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:05:45.884185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-005b9381-97c3-432a-9a98-cf51af19c11c tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "DELETE /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 204 len: 0 microversion: 2.1 time: 0.213707 Apr 20 19:05:45.884831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 675/1341] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:05:45 2021] DELETE /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 19:05:45.894623 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:45.895402 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:45.903339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:45.903848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:45.904688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:45.905185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:46.398158 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:46.413690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-03d94933-cc79-44fa-9125-f5d118bde0e3 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1502 microversion: 2.1 time: 0.523999 Apr 20 19:05:46.414333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 676/1342] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:45 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1502 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:47.084772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:47.085431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:47.093942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.094452 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:47.095356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.095847 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:47.177842 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:05:47.314340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0e950c7e-3bb8-4961-8240-094e41fb7900 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "DELETE /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 204 len: 0 microversion: 2.1 time: 0.233339 Apr 20 19:05:47.315020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 677/1343] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:05:47 2021] DELETE /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 19:05:47.320789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-3515ad06-8642-4c07-8b2c-dbbdbbf9a35d req-ea8a9281-b7ca-46eb-89d9-285c347ee93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:05:47.322483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:05:47.322483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:05:47.331619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-3515ad06-8642-4c07-8b2c-dbbdbbf9a35d req-ea8a9281-b7ca-46eb-89d9-285c347ee93e service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.332054 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-3515ad06-8642-4c07-8b2c-dbbdbbf9a35d req-ea8a9281-b7ca-46eb-89d9-285c347ee93e service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:47.352584 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-3515ad06-8642-4c07-8b2c-dbbdbbf9a35d req-ea8a9281-b7ca-46eb-89d9-285c347ee93e service nova] Creating event network-changed:eea22acf-237e-4f43-91ee-7b618e929ef1 for instance f012e5eb-c916-40af-b54d-b803f861cbd1 on hv-cinder-78693 Apr 20 19:05:47.357726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-3515ad06-8642-4c07-8b2c-dbbdbbf9a35d req-ea8a9281-b7ca-46eb-89d9-285c347ee93e service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041275 Apr 20 19:05:47.358394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 678/1344] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:05:47.364462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:47.365238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:47.373571 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.374082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:47.375488 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.375988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:47.820834 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:47.832955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-858f64f7-0d6c-42b0-9e42-eb19757a8a97 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1566 microversion: 2.1 time: 0.472443 Apr 20 19:05:47.834246 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 679/1345] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:47 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1566 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:05:47.841652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:47.842607 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:47.853671 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.854178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:47.855057 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:47.855593 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:48.262103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554d184d03045f2ba54b1abb3ab118b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad9ae30e0734ba0bda347abdaa58bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:48.275185 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2072f76b-16f7-4a88-ab24-9c099e06004f tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 200 len: 1502 microversion: 2.1 time: 0.439369 Apr 20 19:05:48.277505 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 680/1346] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:47 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:05:48.490327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-014a3827-7c25-4256-a45f-ded645a68865 req-f5f6a670-de1b-4a03-85c1-81a152d4cbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4394c1a1-5a8c-4259-b894-e90109dade42", "name": "network-vif-deleted", "tag": "39c71437-51d9-4359-8ec6-61d53e9484f0"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:05:48.492664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:05:48.492664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:05:48.502067 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-014a3827-7c25-4256-a45f-ded645a68865 req-f5f6a670-de1b-4a03-85c1-81a152d4cbab service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:48.502603 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-014a3827-7c25-4256-a45f-ded645a68865 req-f5f6a670-de1b-4a03-85c1-81a152d4cbab service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:48.674506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-014a3827-7c25-4256-a45f-ded645a68865 req-f5f6a670-de1b-4a03-85c1-81a152d4cbab service nova] Creating event network-vif-deleted:39c71437-51d9-4359-8ec6-61d53e9484f0 for instance 4394c1a1-5a8c-4259-b894-e90109dade42 on hv-cinder-78693 Apr 20 19:05:48.679650 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-014a3827-7c25-4256-a45f-ded645a68865 req-f5f6a670-de1b-4a03-85c1-81a152d4cbab service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194295 Apr 20 19:05:48.680501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 681/1347] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:05:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:05:48.853001 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:48.853773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:48.862201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:48.862741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:48.863594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:48.864091 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:49.114929 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:49.125429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-28d3393f-7cc3-4242-b61b-8fc89e64dde3 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1448 microversion: 2.1 time: 0.276321 Apr 20 19:05:49.126283 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 682/1348] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:48 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1448 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:49.295150 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:49.296018 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] [instance: 4394c1a1-5a8c-4259-b894-e90109dade42] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:49.304527 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:49.305030 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:49.305863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:49.306349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:49.367690 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] HTTP exception thrown: Instance 4394c1a1-5a8c-4259-b894-e90109dade42 could not be found. Apr 20 19:05:49.368373 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] Returning 404 to user: Instance 4394c1a1-5a8c-4259-b894-e90109dade42 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:05:49.369294 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-016b6bd5-4cde-45b6-b3ac-48ec8b8d7b66 tempest-VolumesActionsTest-1425552088 tempest-VolumesActionsTest-1425552088-project] 10.222.0.22 "GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42" status: 404 len: 111 microversion: 2.1 time: 0.078508 Apr 20 19:05:49.369914 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 683/1349] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:49 2021] GET /compute/v2.1/servers/4394c1a1-5a8c-4259-b894-e90109dade42 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:05:50.015409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-0c957f1f-8d12-45cf-a352-6a5d786a28d2 req-28e37c6b-5565-4695-b25a-3e8728bf7740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f012e5eb-c916-40af-b54d-b803f861cbd1", "name": "network-vif-deleted", "tag": "eea22acf-237e-4f43-91ee-7b618e929ef1"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:05:50.017227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:05:50.017227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:05:50.026659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0c957f1f-8d12-45cf-a352-6a5d786a28d2 req-28e37c6b-5565-4695-b25a-3e8728bf7740 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:50.027285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-0c957f1f-8d12-45cf-a352-6a5d786a28d2 req-28e37c6b-5565-4695-b25a-3e8728bf7740 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:50.045129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-0c957f1f-8d12-45cf-a352-6a5d786a28d2 req-28e37c6b-5565-4695-b25a-3e8728bf7740 service nova] Creating event network-vif-deleted:eea22acf-237e-4f43-91ee-7b618e929ef1 for instance f012e5eb-c916-40af-b54d-b803f861cbd1 on hv-cinder-78693 Apr 20 19:05:50.052345 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-0c957f1f-8d12-45cf-a352-6a5d786a28d2 req-28e37c6b-5565-4695-b25a-3e8728bf7740 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041545 Apr 20 19:05:50.052942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 684/1350] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:05:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:05:50.145184 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:50.146181 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:50.154744 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:50.157564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:50.158567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:50.159180 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:50.305943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e08eada99f49f99272e75a5fcb2b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58376bdbb5e446aba6e8e644902c36f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:05:50.315780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-07524fa1-c600-4fc8-8ac6-7bb7d0d412fd tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 200 len: 1218 microversion: 2.1 time: 0.175133 Apr 20 19:05:50.316617 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 685/1351] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:50 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:05:51.335016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:51.335678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] [instance: f012e5eb-c916-40af-b54d-b803f861cbd1] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:05:51.344304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:51.344809 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:51.345639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:05:51.346131 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:05:51.407445 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] HTTP exception thrown: Instance f012e5eb-c916-40af-b54d-b803f861cbd1 could not be found. Apr 20 19:05:51.408130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Returning 404 to user: Instance f012e5eb-c916-40af-b54d-b803f861cbd1 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:05:51.409038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-22a236ee-41d4-44c8-8afa-8f1c64105907 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1" status: 404 len: 111 microversion: 2.1 time: 0.078295 Apr 20 19:05:51.409647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 686/1352] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:05:51 2021] GET /compute/v2.1/servers/f012e5eb-c916-40af-b54d-b803f861cbd1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:05:51.624437 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b672bb19-364c-4c56-b11b-74cf50d1dd68 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] Calling method '.version_select at 0x7f1a17425840>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:05:51.645892 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b672bb19-364c-4c56-b11b-74cf50d1dd68 tempest-TestShelveInstance-1556770747 tempest-TestShelveInstance-1556770747-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-978929302" status: 202 len: 0 microversion: 2.1 time: 0.025484 Apr 20 19:05:51.646551 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 687/1353] 10.222.0.22 () {58 vars in 1241 bytes} [Tue Apr 20 19:05:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-978929302 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:06:31.074490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-11d0b16e-7008-481e-985f-3bf9c05ccff0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Action: 'create', calling method: .version_select at 0x7f1a1c9569d8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2111008047"}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:06:31.099307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-11d0b16e-7008-481e-985f-3bf9c05ccff0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:06:31.103591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-11d0b16e-7008-481e-985f-3bf9c05ccff0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for user a95d15dca78f4f71883aaac8327831ac and project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:06:31.341050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-11d0b16e-7008-481e-985f-3bf9c05ccff0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:06:31.346835 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-11d0b16e-7008-481e-985f-3bf9c05ccff0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for user a95d15dca78f4f71883aaac8327831ac and project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'key_pairs'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:06:31.365101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-11d0b16e-7008-481e-985f-3bf9c05ccff0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.506658 Apr 20 19:06:31.371448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 688/1354] 10.222.0.22 () {60 vars in 1148 bytes} [Tue Apr 20 19:06:30 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:06:50.023566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-229779351", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111008047", "security_groups": [{"name": "tempest-secgroup-smoke-249997479"}], "block_device_mapping_v2": [{"uuid": "71d940a2-d3a6-4767-8d08-b2bdf293281e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "531a37fc-019b-491b-b0c5-cf6cccdcc8fc"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:06:50.211384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] validate_networks() for [('531a37fc-019b-491b-b0c5-cf6cccdcc8fc', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:06:50.918681 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:06:50.919160 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:06:50.919706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:06:50.920168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:06:50.920665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:06:50.929611 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:50.930130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:50.931021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:50.932045 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:50.951050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:06:50.955379 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for user a95d15dca78f4f71883aaac8327831ac and project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:06:51.064956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:06:51.067368 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71d940a2-d3a6-4767-8d08-b2bdf293281e',volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:06:51.247133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d0ef4ef5-f053-47c8-ab33-b3b7335ded69 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.228302 Apr 20 19:06:51.247831 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 689/1355] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 19:06:50 2021] POST /compute/v2.1/servers => generated 405 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:06:51.258786 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-968c046f-81eb-4e53-9c50-fd1e67f1aa07 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:51.259981 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-968c046f-81eb-4e53-9c50-fd1e67f1aa07 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:51.340011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-968c046f-81eb-4e53-9c50-fd1e67f1aa07 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:51.348749 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-968c046f-81eb-4e53-9c50-fd1e67f1aa07 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1094 microversion: 2.1 time: 0.093982 Apr 20 19:06:51.349350 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 690/1356] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:51 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:06:52.367639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4159e2bd-a985-4056-957e-6f19aa9dea05 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:52.368304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-4159e2bd-a985-4056-957e-6f19aa9dea05 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:52.450484 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-4159e2bd-a985-4056-957e-6f19aa9dea05 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:52.458790 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4159e2bd-a985-4056-957e-6f19aa9dea05 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1094 microversion: 2.1 time: 0.095034 Apr 20 19:06:52.459375 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 691/1357] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:52 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:06:53.477197 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:53.477866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:53.486866 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:53.487377 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:53.488215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:53.488707 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:53.618024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:53.626885 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2859c561-f62b-4eba-b3fe-b281c8345f40 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1144 microversion: 2.1 time: 0.153669 Apr 20 19:06:53.627500 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 692/1358] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:53 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1144 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:06:54.650949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:54.652392 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:54.668852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:54.669897 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:54.671910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:54.673063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:54.845073 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:54.855803 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b9af3dc4-3a46-4ae6-8f3f-4475e78a8530 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1210 microversion: 2.1 time: 0.213752 Apr 20 19:06:54.856525 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 693/1359] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:54 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1210 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:06:55.874645 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:55.875319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:55.883746 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:55.884660 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:55.885735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:55.886232 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:56.322248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:56.331511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-72d189f3-a413-433b-a247-0beda4cc0bc2 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.461272 Apr 20 19:06:56.332168 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 694/1360] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:55 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:06:56.813238 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-94664dd0-8dad-4475-a6d1-0bff1fa04740 req-63bfd7cf-1e64-4bbe-a9f7-0defd3bb54af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332dffbc-fb8f-4dd4-9a91-d62e149d4d37", "tag": "697af25f-c6fd-4505-935a-27a472b8d213"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:06:56.815118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:06:56.815118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:06:56.831783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-94664dd0-8dad-4475-a6d1-0bff1fa04740 req-63bfd7cf-1e64-4bbe-a9f7-0defd3bb54af service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:56.832346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-94664dd0-8dad-4475-a6d1-0bff1fa04740 req-63bfd7cf-1e64-4bbe-a9f7-0defd3bb54af service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:56.863780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-94664dd0-8dad-4475-a6d1-0bff1fa04740 req-63bfd7cf-1e64-4bbe-a9f7-0defd3bb54af service nova] Creating event network-changed:697af25f-c6fd-4505-935a-27a472b8d213 for instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 on hv-cinder-78693 Apr 20 19:06:56.872928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-94664dd0-8dad-4475-a6d1-0bff1fa04740 req-63bfd7cf-1e64-4bbe-a9f7-0defd3bb54af service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060978 Apr 20 19:06:56.872928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 695/1361] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:06:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:06:57.351299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:57.352083 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:57.360647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:57.361142 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:57.361995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:57.362510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:57.802557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:57.813124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f283d60d-33df-4de1-b56b-5ad0f8d2fefd tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.466523 Apr 20 19:06:57.813766 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 696/1362] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:57 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:06:58.831851 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:06:58.832526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:06:58.840545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:58.841050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:58.841894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:06:58.842387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:06:59.062395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:06:59.072020 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-afb59e1f-8251-4773-8016-b276fa9d0fff tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.243610 Apr 20 19:06:59.072636 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 697/1363] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:06:58 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:00.089619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:00.090267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:00.098183 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:00.098726 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:00.099566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:00.100062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:00.316239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:00.325747 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-35ffa8fc-e25d-42de-9578-b5b40509e94b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.240278 Apr 20 19:07:00.326370 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 698/1364] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:00 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:01.344763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:01.345435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:01.353925 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:01.354429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:01.355289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:01.355781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:01.576489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:01.585342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f622a91d-703d-4fdc-9673-3cb26e4e5a75 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.245227 Apr 20 19:07:01.585955 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 699/1365] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:01 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:02.604479 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:02.605141 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:02.614669 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:02.615173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:02.616010 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:02.616497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:02.839021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:02.848088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-539e762a-d18b-46ed-87fc-e63a38d78793 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.248187 Apr 20 19:07:02.848728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 700/1366] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:02 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:03.867359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:03.868574 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:03.877193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:03.877714 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:03.878825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:03.879335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:04.091133 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:04.100029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-a4e06b3f-cff4-4af2-a703-446c18c96c4b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.236768 Apr 20 19:07:04.100654 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 701/1367] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:03 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:05.119124 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:05.119795 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:05.128078 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:05.128597 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:05.129450 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:05.129947 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:05.353511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:05.363805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f4dc636-4132-46a7-afef-1c31798122f7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.248816 Apr 20 19:07:05.364442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 702/1368] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:05 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:06.382130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:06.382827 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:06.391703 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:06.392453 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:06.393272 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:06.393913 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:06.612050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:06.621587 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-64e5c4f5-fe83-4754-a595-926be8a5b486 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.243630 Apr 20 19:07:06.622210 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 703/1369] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:06 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:07.640024 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:07.640698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:07.649469 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:07.649985 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:07.650875 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:07.651378 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:07.876559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:07.886441 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-af21b1d8-ca34-4a9d-8ce4-e30812187753 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.250290 Apr 20 19:07:07.887023 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 704/1370] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:07 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:08.911698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:08.912366 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:08.921140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:08.921652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:08.922506 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:08.923007 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:09.152510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:09.161772 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b557aea0-15e9-470b-a92b-bd569d1de8d7 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.254058 Apr 20 19:07:09.162661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 705/1371] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:08 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:09.349559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-ad170976-de2c-4c0a-b0bd-9d818807964d req-906b16a4-c00b-4018-b635-27ad8deb5d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332dffbc-fb8f-4dd4-9a91-d62e149d4d37", "name": "network-vif-plugged", "status": "completed", "tag": "697af25f-c6fd-4505-935a-27a472b8d213"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:07:09.351403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:07:09.351403 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:07:09.361464 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ad170976-de2c-4c0a-b0bd-9d818807964d req-906b16a4-c00b-4018-b635-27ad8deb5d05 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:09.361967 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-ad170976-de2c-4c0a-b0bd-9d818807964d req-906b16a4-c00b-4018-b635-27ad8deb5d05 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:09.380663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-ad170976-de2c-4c0a-b0bd-9d818807964d req-906b16a4-c00b-4018-b635-27ad8deb5d05 service nova] Creating event network-vif-plugged:697af25f-c6fd-4505-935a-27a472b8d213 for instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 on hv-cinder-78693 Apr 20 19:07:09.386059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-ad170976-de2c-4c0a-b0bd-9d818807964d req-906b16a4-c00b-4018-b635-27ad8deb5d05 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041026 Apr 20 19:07:09.386782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 706/1372] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:07:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:07:10.181515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:10.182326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:10.190580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:10.191090 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:10.191922 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:10.192414 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:10.416271 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:10.425906 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d1694e49-e6b2-4535-ad81-1557c699a5df tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1265 microversion: 2.1 time: 0.249537 Apr 20 19:07:10.426565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 707/1373] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:10 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:11.444961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:11.446148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:11.454231 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:11.454778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:11.455608 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:11.456108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:11.673559 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:11.683156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fac0a42d-d6e2-4358-9d89-131caf8b1997 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1451 microversion: 2.1 time: 0.242301 Apr 20 19:07:11.683785 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 708/1374] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:11 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:11.700868 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:07:11.701466 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:07:11.709265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:11.709763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:11.710644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:11.711767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:11.937961 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:07:11.947779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3d4ec864-d575-4dcf-ad06-6786c1d603fa tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1451 microversion: 2.1 time: 0.250798 Apr 20 19:07:11.948408 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 709/1375] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:07:11 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1451 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:07:14.684387 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:07:14.688346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-6c281694-31ca-4789-b78e-a1bca301877e req-6cd4c698-d576-49d7-b861-4c3f9b925040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332dffbc-fb8f-4dd4-9a91-d62e149d4d37", "tag": "697af25f-c6fd-4505-935a-27a472b8d213"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:07:14.690259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:07:14.690259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:07:14.699975 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6c281694-31ca-4789-b78e-a1bca301877e req-6cd4c698-d576-49d7-b861-4c3f9b925040 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:07:14.700467 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6c281694-31ca-4789-b78e-a1bca301877e req-6cd4c698-d576-49d7-b861-4c3f9b925040 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:07:14.718404 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-6c281694-31ca-4789-b78e-a1bca301877e req-6cd4c698-d576-49d7-b861-4c3f9b925040 service nova] Creating event network-changed:697af25f-c6fd-4505-935a-27a472b8d213 for instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 on hv-cinder-78693 Apr 20 19:07:14.723969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-6c281694-31ca-4789-b78e-a1bca301877e req-6cd4c698-d576-49d7-b861-4c3f9b925040 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041590 Apr 20 19:07:14.724668 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 710/1376] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:07:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:09:04.869994 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:04.870678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:04.892562 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:04.893066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:04.893904 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:04.894443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:04.932225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 49258. Apr 20 19:09:04.962223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:09:05.084028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e244af24-bce5-488a-8c1c-8d2ddd5a99e1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "DELETE /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 204 len: 0 microversion: 2.1 time: 0.218159 Apr 20 19:09:05.084692 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 711/1377] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:09:04 2021] DELETE /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 19:09:05.093738 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:05.094605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:05.102576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:05.103084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:05.103928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:05.104427 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:05.327455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:05.336691 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5ee29376-5b9c-416e-936d-3716ceeb1e76 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1575 microversion: 2.1 time: 0.247370 Apr 20 19:09:05.337225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 712/1378] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:05 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:06.355735 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:06.356423 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:06.365298 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:06.365824 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:06.368273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:06.368273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:06.586567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:06.595637 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-97a1f082-1ac5-468e-9388-9ef41eaefce6 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1575 microversion: 2.1 time: 0.244096 Apr 20 19:09:06.596266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 713/1379] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:06 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:07.614399 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:07.615171 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:07.623745 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:07.624259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:07.625109 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:07.625657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:07.808600 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:07.819722 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ddcc6c2f-4b41-450a-8db3-5539d6944f3b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1508 microversion: 2.1 time: 0.210076 Apr 20 19:09:07.820907 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 714/1380] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:07 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:08.309709 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-6be18b3a-b59b-46e0-ac3c-bcde4404992f req-8baf694a-6e58-4ca7-b1d3-1ef98b252dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332dffbc-fb8f-4dd4-9a91-d62e149d4d37", "name": "network-vif-deleted", "tag": "697af25f-c6fd-4505-935a-27a472b8d213"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:09:08.311924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:09:08.311924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:09:08.322037 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6be18b3a-b59b-46e0-ac3c-bcde4404992f req-8baf694a-6e58-4ca7-b1d3-1ef98b252dfc service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:08.322569 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6be18b3a-b59b-46e0-ac3c-bcde4404992f req-8baf694a-6e58-4ca7-b1d3-1ef98b252dfc service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:08.344195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-6be18b3a-b59b-46e0-ac3c-bcde4404992f req-8baf694a-6e58-4ca7-b1d3-1ef98b252dfc service nova] Creating event network-vif-deleted:697af25f-c6fd-4505-935a-27a472b8d213 for instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 on hv-cinder-78693 Apr 20 19:09:08.350565 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-6be18b3a-b59b-46e0-ac3c-bcde4404992f req-8baf694a-6e58-4ca7-b1d3-1ef98b252dfc service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045113 Apr 20 19:09:08.351252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 715/1381] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:09:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:09:08.839485 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:08.840266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:08.849394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:08.850224 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:08.851321 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:08.851806 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:09.011364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:09.021337 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-73516fa7-b9f4-4c56-954c-cded4e9337a0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 200 len: 1225 microversion: 2.1 time: 0.186417 Apr 20 19:09:09.021969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 716/1382] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:08 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:10.040531 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:10.041134 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:10.049299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:10.049794 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:10.051302 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:10.052476 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:10.106865 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] HTTP exception thrown: Instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 could not be found. Apr 20 19:09:10.107547 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Returning 404 to user: Instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:09:10.108471 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0ad55b3a-f8da-4e0f-bfa3-82e166b335c1 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 404 len: 111 microversion: 2.1 time: 0.072326 Apr 20 19:09:10.109107 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 717/1383] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:10 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:09:10.176695 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-671794936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111008047", "security_groups": [{"name": "tempest-secgroup-smoke-249997479"}], "block_device_mapping_v2": [{"uuid": "71d940a2-d3a6-4767-8d08-b2bdf293281e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "531a37fc-019b-491b-b0c5-cf6cccdcc8fc"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:09:10.358319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] validate_networks() for [('531a37fc-019b-491b-b0c5-cf6cccdcc8fc', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:09:10.895731 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:09:10.896056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:09:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.22) !!! Apr 20 19:09:10.954859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:09:10.955338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:09:10.955884 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:09:10.956349 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:09:10.956817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:09:10.966038 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:10.966573 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:10.967451 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:10.967942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:10.986685 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:09:10.991575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for user a95d15dca78f4f71883aaac8327831ac and project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:09:11.100894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:09:11.103338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71d940a2-d3a6-4767-8d08-b2bdf293281e',volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:09:11.289698 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6f426c1c-3d6c-4c69-9d0b-00c4f49a80f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.121237 Apr 20 19:09:11.290407 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 718/1384] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 19:09:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:09:11.302269 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-88275cb1-1ce3-4407-aaa3-9f0e91a1bb58 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:11.302979 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-88275cb1-1ce3-4407-aaa3-9f0e91a1bb58 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:11.391689 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-88275cb1-1ce3-4407-aaa3-9f0e91a1bb58 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:11.399927 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-88275cb1-1ce3-4407-aaa3-9f0e91a1bb58 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1094 microversion: 2.1 time: 0.102571 Apr 20 19:09:11.400661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 719/1385] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:11 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:12.420376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:12.420376 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:12.429316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:12.429828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:12.430980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:12.431510 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:12.581156 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:12.591545 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-25d0fa25-6dc0-4b6d-8072-aad85ae29048 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1200 microversion: 2.1 time: 0.176395 Apr 20 19:09:12.592799 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 720/1386] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:12 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1200 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:13.609684 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:13.610362 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:13.619275 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:13.619788 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:13.620652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:13.621148 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:14.070281 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:14.079557 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-1648748d-a745-4863-9208-c420c4e0ccf3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.473969 Apr 20 19:09:14.080201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 721/1387] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:13 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:14.864507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-67bb5c9a-d4ed-479b-a869-f484589b1618 req-0c111e9f-9b04-4c89-9e23-030f540be7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059752c3-215f-4f88-bda4-89a71334a7ad", "tag": "63c57279-c059-45a9-8152-5e9016099229"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:09:14.866209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:09:14.866209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:09:14.877956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-67bb5c9a-d4ed-479b-a869-f484589b1618 req-0c111e9f-9b04-4c89-9e23-030f540be7a3 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:14.877956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-67bb5c9a-d4ed-479b-a869-f484589b1618 req-0c111e9f-9b04-4c89-9e23-030f540be7a3 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:14.905952 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-67bb5c9a-d4ed-479b-a869-f484589b1618 req-0c111e9f-9b04-4c89-9e23-030f540be7a3 service nova] Creating event network-changed:63c57279-c059-45a9-8152-5e9016099229 for instance 059752c3-215f-4f88-bda4-89a71334a7ad on hv-cinder-78693 Apr 20 19:09:14.911606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-67bb5c9a-d4ed-479b-a869-f484589b1618 req-0c111e9f-9b04-4c89-9e23-030f540be7a3 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051786 Apr 20 19:09:14.912266 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 722/1388] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:09:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:09:15.098844 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:15.099605 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:15.108014 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:15.108524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:15.109385 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:15.109882 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:15.501612 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:15.510657 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ab7cd31a-3786-4f6d-9587-def890df8125 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.416907 Apr 20 19:09:15.511364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 723/1389] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:15 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:16.529354 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:16.530028 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:16.538943 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:16.539456 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:16.540304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:16.540796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:16.754297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:16.763656 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3d506a92-991d-4b1e-80ec-174ebe666303 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.238340 Apr 20 19:09:16.764594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 724/1390] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:16 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:17.782011 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:17.782715 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:17.793211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:17.793725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:17.794628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:17.795129 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:18.013676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:18.023390 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-adc4265e-93bf-4ba8-bc49-89a9be8acc5c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.245479 Apr 20 19:09:18.024039 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 725/1391] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:17 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:19.041712 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:19.042381 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:19.050591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:19.051106 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:19.051997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:19.052429 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:19.269980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:19.279108 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6925c3c3-c06a-4b27-88a6-fce8c7915d59 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.241594 Apr 20 19:09:19.279724 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 726/1392] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:19 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:20.297409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:20.298130 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:20.306068 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:20.306604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:20.307440 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:20.307942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:20.525642 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:20.535480 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d668a3b9-1522-4d62-93d1-3b0323a88250 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.242133 Apr 20 19:09:20.536101 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 727/1393] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:20 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:21.554145 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:21.554816 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:21.563204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:21.563710 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:21.564554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:21.565048 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:21.791513 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:21.801301 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5a7fc92d-192c-49c8-95ce-7baa74123d22 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.251733 Apr 20 19:09:21.801931 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 728/1394] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:21 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:22.819996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:22.820666 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:22.828663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:22.829163 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:22.830110 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:22.830674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:23.050895 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:23.060166 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fb9df06b-dd31-4bc3-b7ad-c7bc998d9728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.244668 Apr 20 19:09:23.060739 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 729/1395] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:22 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:24.079346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:24.079883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:24.088538 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:24.089055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:24.089919 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:24.090415 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:24.560659 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:24.572519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-2d9c22d7-8296-4887-b257-91aeff68fbdf tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.497378 Apr 20 19:09:24.573346 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 730/1396] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:24 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:25.591297 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:25.591973 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:25.600818 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:25.601201 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:25.602055 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:25.602576 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:25.834435 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:25.843775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5f737daf-539b-4c6a-a715-40e91eddea52 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.256559 Apr 20 19:09:25.844339 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 731/1397] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:25 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:09:25.994867 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-6108f3b1-494f-4955-bd70-a64ff2c09b89 req-584e8e82-59b2-4d5e-8bab-19cba2cf7263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059752c3-215f-4f88-bda4-89a71334a7ad", "name": "network-vif-plugged", "status": "completed", "tag": "63c57279-c059-45a9-8152-5e9016099229"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:09:25.996763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:09:25.996763 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:09:26.006613 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6108f3b1-494f-4955-bd70-a64ff2c09b89 req-584e8e82-59b2-4d5e-8bab-19cba2cf7263 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:26.007111 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-6108f3b1-494f-4955-bd70-a64ff2c09b89 req-584e8e82-59b2-4d5e-8bab-19cba2cf7263 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:26.024924 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-6108f3b1-494f-4955-bd70-a64ff2c09b89 req-584e8e82-59b2-4d5e-8bab-19cba2cf7263 service nova] Creating event network-vif-plugged:63c57279-c059-45a9-8152-5e9016099229 for instance 059752c3-215f-4f88-bda4-89a71334a7ad on hv-cinder-78693 Apr 20 19:09:26.030372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-6108f3b1-494f-4955-bd70-a64ff2c09b89 req-584e8e82-59b2-4d5e-8bab-19cba2cf7263 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039616 Apr 20 19:09:26.031056 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 732/1398] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:09:26.863507 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:26.864338 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:26.873769 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:26.874285 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:26.875174 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:26.875672 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:27.101954 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:27.111261 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-653aa2c3-1854-4d96-8f12-5dfcdb01da0f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1265 microversion: 2.1 time: 0.252517 Apr 20 19:09:27.111890 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 733/1399] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:26 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:27.894583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:09:27.895663 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:09:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:09:28.129727 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:28.130305 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:28.138425 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:28.138980 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:28.139820 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:28.140310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:28.361058 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:28.370674 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-805f3a25-c70b-4957-b570-3f44a7a1d728 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1451 microversion: 2.1 time: 0.245185 Apr 20 19:09:28.371308 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 734/1400] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:28 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1451 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:28.387920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:28.388509 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:09:28.397063 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:28.397564 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:28.398398 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:28.398942 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:28.611025 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:09:28.619910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-249a01c2-c1e2-4d98-994e-64e074cf1988 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1451 microversion: 2.1 time: 0.236059 Apr 20 19:09:28.620521 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 735/1401] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:09:28 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1451 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:09:31.104923 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-8da83583-6b77-4959-9766-728478bf5d0c req-9d92eab6-d18b-4bc6-bc41-24f83bb67ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059752c3-215f-4f88-bda4-89a71334a7ad", "tag": "63c57279-c059-45a9-8152-5e9016099229"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:09:31.107397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:09:31.107397 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:09:31.117848 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-8da83583-6b77-4959-9766-728478bf5d0c req-9d92eab6-d18b-4bc6-bc41-24f83bb67ea5 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:31.118344 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-8da83583-6b77-4959-9766-728478bf5d0c req-9d92eab6-d18b-4bc6-bc41-24f83bb67ea5 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:31.136128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-8da83583-6b77-4959-9766-728478bf5d0c req-9d92eab6-d18b-4bc6-bc41-24f83bb67ea5 service nova] Creating event network-changed:63c57279-c059-45a9-8152-5e9016099229 for instance 059752c3-215f-4f88-bda4-89a71334a7ad on hv-cinder-78693 Apr 20 19:09:31.141534 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-8da83583-6b77-4959-9766-728478bf5d0c req-9d92eab6-d18b-4bc6-bc41-24f83bb67ea5 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040541 Apr 20 19:09:31.142248 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 736/1402] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:09:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:18.038857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] AMQP server on 10.222.0.22:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 20 19:11:18.043641 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2014613574", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111008047", "security_groups": [{"name": "tempest-secgroup-smoke-249997479"}], "block_device_mapping_v2": [{"uuid": "ab66c8b2-9e25-446c-957a-a9ea3d2aa553", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "531a37fc-019b-491b-b0c5-cf6cccdcc8fc"}]}} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:18.371359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.network.neutron [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] validate_networks() for [('531a37fc-019b-491b-b0c5-cf6cccdcc8fc', None, None, None)] {{(pid=100570) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:11:18.947369 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Flavor limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:11:18.947860 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Image limits 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:11:18.949021 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Flavor pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:11:18.949524 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Image pref 0:0:0 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:11:18.949964 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.virt.hardware [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:11:18.958900 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:18.959416 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:18.960293 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:18.960793 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:18.982222 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:11:18.986594 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.quota [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Getting quotas for user a95d15dca78f4f71883aaac8327831ac and project aae127a36d1f43d28692c8a8bab8cf98. Resources: {'cores', 'ram', 'instances'} {{(pid=100570) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:11:19.055088 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] [aaff6f1f-69ab-4854-b400-b941554cc2db] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 49410. Apr 20 19:11:19.094265 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Going to run 1 instances... {{(pid=100570) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:11:19.096880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab66c8b2-9e25-446c-957a-a9ea3d2aa553',volume_size=None,volume_type=None)] {{(pid=100570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:11:19.273694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5cf48010-a6ec-4378-8b9d-0160298399bb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.236685 Apr 20 19:11:19.274394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 737/1403] 10.222.0.22 () {60 vars in 1137 bytes} [Tue Apr 20 19:11:18 2021] POST /compute/v2.1/servers => generated 405 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:11:19.285796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-97bb6b89-5d2a-454d-9973-ca272bc443f8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:19.286499 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-97bb6b89-5d2a-454d-9973-ca272bc443f8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:19.371307 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-97bb6b89-5d2a-454d-9973-ca272bc443f8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:19.379465 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-97bb6b89-5d2a-454d-9973-ca272bc443f8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1095 microversion: 2.1 time: 0.097657 Apr 20 19:11:19.380089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 738/1404] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:19 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:20.398267 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:20.399179 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:20.408260 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:20.408781 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:20.409677 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:20.410187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:20.565520 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:20.575498 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-5a8985de-4f47-4080-bbb1-73e3e77a16c0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1201 microversion: 2.1 time: 0.181390 Apr 20 19:11:20.576563 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 739/1405] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:20 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1201 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:21.596167 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:21.596938 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:21.605624 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:21.606069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:21.607003 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:21.607493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:22.094876 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:22.104595 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-56414903-3bb5-4587-8a56-093944da68f0 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1278 microversion: 2.1 time: 0.512731 Apr 20 19:11:22.105241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 740/1406] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:21 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1278 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:11:23.109928 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-e284d0f6-dd01-4be3-b51c-123b5466a718 req-4055807a-23cb-47cb-ba27-92bde6a9523d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493e9355-cd14-42fb-8583-95508bc2bbbe", "tag": "e6cb2a14-10b4-4f58-8628-7fd9195bde14"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:23.112016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:11:23.112016 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:11:23.122187 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-e284d0f6-dd01-4be3-b51c-123b5466a718 req-4055807a-23cb-47cb-ba27-92bde6a9523d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:23.123062 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-e284d0f6-dd01-4be3-b51c-123b5466a718 req-4055807a-23cb-47cb-ba27-92bde6a9523d service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:23.142644 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-e284d0f6-dd01-4be3-b51c-123b5466a718 req-4055807a-23cb-47cb-ba27-92bde6a9523d service nova] Creating event network-changed:e6cb2a14-10b4-4f58-8628-7fd9195bde14 for instance 493e9355-cd14-42fb-8583-95508bc2bbbe on hv-cinder-78693 Apr 20 19:11:23.148080 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-e284d0f6-dd01-4be3-b51c-123b5466a718 req-4055807a-23cb-47cb-ba27-92bde6a9523d service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110312 Apr 20 19:11:23.148796 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 741/1407] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:11:23.155211 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:23.155996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:23.164383 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:23.164899 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:23.165741 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:23.166433 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:23.540117 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:23.549995 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-b626e440-513f-481c-974c-05d1d0d4016c tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.399878 Apr 20 19:11:23.550643 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 742/1408] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:23 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:11:24.569618 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:24.570486 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:24.578805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:24.579328 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:24.580193 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:24.580693 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:24.845209 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:24.855031 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-0d70139d-274b-42be-ac62-ff810c7448f5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.289531 Apr 20 19:11:24.855661 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 743/1409] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:24 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:25.873852 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:25.874541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:25.882863 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:25.883367 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:25.884215 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:25.884706 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:26.171482 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:26.180880 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3f584b8b-c102-4efd-b886-aa928b1a28ca tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.311747 Apr 20 19:11:26.181526 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 744/1410] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:25 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:27.200065 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:27.200729 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:27.208664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:27.209165 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:27.210002 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:27.210516 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:27.434489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:27.443758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-ebc79b2b-aaf1-4f69-8e29-9407d7d6efd3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.248329 Apr 20 19:11:27.444394 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 745/1411] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:27 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:28.461843 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:28.462528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:28.470723 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:28.471225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:28.472066 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:28.472554 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:28.687541 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:28.696700 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-41bd4e55-2352-4da5-a80f-a78ca9d1c9e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.238890 Apr 20 19:11:28.697926 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 746/1412] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:28 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:29.766778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:29.767459 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:29.776177 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:29.776694 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:29.777767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:29.778310 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:29.998678 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:30.007742 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-37e3f703-6ed6-4ad7-a42d-e15f19f8be60 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.296383 Apr 20 19:11:30.008382 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 747/1413] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:29 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:31.026626 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:31.027299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:31.036442 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:31.036945 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:31.037780 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:31.038268 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:31.254247 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:31.263483 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-959d4d0a-5830-4879-b853-abf23d937bcc tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.240986 Apr 20 19:11:31.264104 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 748/1414] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:31 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:32.285128 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:32.286356 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:32.296934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:32.297443 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:32.298289 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:32.298828 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:32.521901 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:32.531489 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-7d94b35f-f37d-42b0-a8ac-5366af122d74 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.253176 Apr 20 19:11:32.532132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 749/1415] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:32 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:11:33.553647 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:33.554372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:33.563173 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:33.563679 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:33.564515 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:33.565006 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:33.786384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:33.797501 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-e9da416f-7446-4165-a164-a1430ed23bab tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.250331 Apr 20 19:11:33.798351 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 750/1416] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:33 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:11:34.665640 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-1f990b99-0b5b-4771-bcaf-591c89705019 req-9ce15f59-44b2-45da-921c-651df00e7c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493e9355-cd14-42fb-8583-95508bc2bbbe", "name": "network-vif-plugged", "status": "completed", "tag": "e6cb2a14-10b4-4f58-8628-7fd9195bde14"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:34.667575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:11:34.667575 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:11:34.677463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1f990b99-0b5b-4771-bcaf-591c89705019 req-9ce15f59-44b2-45da-921c-651df00e7c20 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:34.678103 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-1f990b99-0b5b-4771-bcaf-591c89705019 req-9ce15f59-44b2-45da-921c-651df00e7c20 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:34.697639 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-1f990b99-0b5b-4771-bcaf-591c89705019 req-9ce15f59-44b2-45da-921c-651df00e7c20 service nova] Creating event network-vif-plugged:e6cb2a14-10b4-4f58-8628-7fd9195bde14 for instance 493e9355-cd14-42fb-8583-95508bc2bbbe on hv-cinder-78693 Apr 20 19:11:34.703227 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-1f990b99-0b5b-4771-bcaf-591c89705019 req-9ce15f59-44b2-45da-921c-651df00e7c20 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102730 Apr 20 19:11:34.703891 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 751/1417] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:11:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:11:34.816560 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:34.817462 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:34.826095 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:34.826670 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:34.827537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:34.828089 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:35.143504 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:35.153304 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d5f9bbcb-8442-456f-973e-e685385f7092 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.341361 Apr 20 19:11:35.153937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 752/1418] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:34 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:36.172713 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:36.173326 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:36.181773 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:36.182273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:36.183195 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:36.183683 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:36.419290 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:36.428474 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f10ff90b-2b46-49ba-b377-7ea238090a7e tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1266 microversion: 2.1 time: 0.259994 Apr 20 19:11:36.429034 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 753/1419] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:36 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:37.446490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:37.447213 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:37.455323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:37.455817 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:37.456658 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:37.457157 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:37.671783 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:37.680779 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3c19546e-7609-4f87-a24a-4457dbb6dc54 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1452 microversion: 2.1 time: 0.238388 Apr 20 19:11:37.681409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 754/1420] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:37 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:37.697908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:37.698596 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:11:37.706448 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:37.706977 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:37.707812 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:37.708299 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:37.931999 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:11:37.941139 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-af69dcab-2bf4-4ee3-a3ac-c3080a203ebe tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1452 microversion: 2.1 time: 0.247257 Apr 20 19:11:37.941770 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 755/1421] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:11:37 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1452 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:11:40.658872 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-fad9c0f7-1005-430c-8a89-9c3ee477e663 req-a701776b-dca8-45d9-af6d-00c5bed6a94f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493e9355-cd14-42fb-8583-95508bc2bbbe", "tag": "e6cb2a14-10b4-4f58-8628-7fd9195bde14"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:40.661409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:11:40.661409 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:11:40.671540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-fad9c0f7-1005-430c-8a89-9c3ee477e663 req-a701776b-dca8-45d9-af6d-00c5bed6a94f service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:11:40.672040 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-fad9c0f7-1005-430c-8a89-9c3ee477e663 req-a701776b-dca8-45d9-af6d-00c5bed6a94f service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:11:40.690204 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-fad9c0f7-1005-430c-8a89-9c3ee477e663 req-a701776b-dca8-45d9-af6d-00c5bed6a94f service nova] Creating event network-changed:e6cb2a14-10b4-4f58-8628-7fd9195bde14 for instance 493e9355-cd14-42fb-8583-95508bc2bbbe on hv-cinder-78693 Apr 20 19:11:40.695652 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-fad9c0f7-1005-430c-8a89-9c3ee477e663 req-a701776b-dca8-45d9-af6d-00c5bed6a94f service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041239 Apr 20 19:11:40.696359 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 756/1422] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:11:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:12:47.913361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:12:47.913944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:12:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:13:11.976969 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:11.977621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:11.985859 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:11.986363 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:11.987252 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:11.987743 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:12.054497 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:13:12.177372 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-c123ec35-05d0-41de-82d9-30fa414a0066 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "DELETE /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 204 len: 0 microversion: 2.1 time: 0.205938 Apr 20 19:13:12.178316 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 757/1423] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:13:11 2021] DELETE /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:13:12.183971 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-86ae9b17-2e18-4fc0-a422-fb602a0db714 req-cc30342b-3791-4c3e-8ebd-39aedba3b94f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493e9355-cd14-42fb-8583-95508bc2bbbe", "tag": "e6cb2a14-10b4-4f58-8628-7fd9195bde14"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:13:12.185653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:13:12.185653 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:13:12.194664 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-86ae9b17-2e18-4fc0-a422-fb602a0db714 req-cc30342b-3791-4c3e-8ebd-39aedba3b94f service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:12.195140 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-86ae9b17-2e18-4fc0-a422-fb602a0db714 req-cc30342b-3791-4c3e-8ebd-39aedba3b94f service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:12.213840 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-86ae9b17-2e18-4fc0-a422-fb602a0db714 req-cc30342b-3791-4c3e-8ebd-39aedba3b94f service nova] Creating event network-changed:e6cb2a14-10b4-4f58-8628-7fd9195bde14 for instance 493e9355-cd14-42fb-8583-95508bc2bbbe on hv-cinder-78693 Apr 20 19:13:12.219335 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-86ae9b17-2e18-4fc0-a422-fb602a0db714 req-cc30342b-3791-4c3e-8ebd-39aedba3b94f service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039654 Apr 20 19:13:12.219934 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 758/1424] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:13:12.226147 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:12.226932 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:12.235395 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:12.235896 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:12.236740 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:12.237225 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:12.877292 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:13:12.887984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-3b9fe1e2-6796-4e1d-9095-d7cbbb4ba9ad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1577 microversion: 2.1 time: 0.666751 Apr 20 19:13:12.888874 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 759/1425] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:12 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1577 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:13:13.907233 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:13.907819 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:13.915984 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:13.916490 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:13.917329 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:13.921908 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:14.332273 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:13:14.342017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-fb51001f-8789-4d59-b945-018246bf27f9 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1458 microversion: 2.1 time: 0.438354 Apr 20 19:13:14.342894 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 760/1426] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:13 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1458 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:13:14.907123 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-47bdaf24-05ed-4857-bc59-0166949b2770 req-6d633160-771e-4df9-9ca0-1d5d0dcd74f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493e9355-cd14-42fb-8583-95508bc2bbbe", "name": "network-vif-deleted", "tag": "e6cb2a14-10b4-4f58-8628-7fd9195bde14"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:13:14.909323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:13:14.909323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:13:14.920032 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-47bdaf24-05ed-4857-bc59-0166949b2770 req-6d633160-771e-4df9-9ca0-1d5d0dcd74f0 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:14.920540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-47bdaf24-05ed-4857-bc59-0166949b2770 req-6d633160-771e-4df9-9ca0-1d5d0dcd74f0 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:14.938948 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-47bdaf24-05ed-4857-bc59-0166949b2770 req-6d633160-771e-4df9-9ca0-1d5d0dcd74f0 service nova] Creating event network-vif-deleted:e6cb2a14-10b4-4f58-8628-7fd9195bde14 for instance 493e9355-cd14-42fb-8583-95508bc2bbbe on hv-cinder-78693 Apr 20 19:13:14.944322 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-47bdaf24-05ed-4857-bc59-0166949b2770 req-6d633160-771e-4df9-9ca0-1d5d0dcd74f0 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041630 Apr 20 19:13:14.944997 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 761/1427] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:13:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:13:15.361327 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:15.362093 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:15.370241 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:15.370782 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:15.371621 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:15.372118 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:15.515519 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:13:15.525537 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-714878b6-3432-40c4-bd19-074b61719d11 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 200 len: 1226 microversion: 2.1 time: 0.168810 Apr 20 19:13:15.526619 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 762/1428] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:15 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 1226 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:13:16.543992 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:16.544688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 493e9355-cd14-42fb-8583-95508bc2bbbe] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:16.553191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:16.553688 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:16.554580 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:16.555069 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:16.611008 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] HTTP exception thrown: Instance 493e9355-cd14-42fb-8583-95508bc2bbbe could not be found. Apr 20 19:13:16.611676 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Returning 404 to user: Instance 493e9355-cd14-42fb-8583-95508bc2bbbe could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:13:16.612591 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-20ce12d9-24ce-4d29-9e41-038dfc136864 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe" status: 404 len: 111 microversion: 2.1 time: 0.072697 Apr 20 19:13:16.613716 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 763/1429] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:16 2021] GET /compute/v2.1/servers/493e9355-cd14-42fb-8583-95508bc2bbbe => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:13:20.584029 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:20.585319 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:20.594342 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:20.594905 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:20.595758 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:20.596253 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:20.666910 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Going to try to terminate instance {{(pid=100570) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:13:20.792805 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-6c881449-b0a8-41ff-9cfd-08870a2c51cb tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "DELETE /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 204 len: 0 microversion: 2.1 time: 0.213561 Apr 20 19:13:20.793855 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 764/1430] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:13:20 2021] DELETE /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:13:20.800687 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-2a0a59bd-5162-4b68-9b11-4c7c67e28a95 req-feeaab9d-bc8e-4b52-9494-b64f22f4023e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059752c3-215f-4f88-bda4-89a71334a7ad", "tag": "63c57279-c059-45a9-8152-5e9016099229"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:13:20.802239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:13:20.802239 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:13:20.812767 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-2a0a59bd-5162-4b68-9b11-4c7c67e28a95 req-feeaab9d-bc8e-4b52-9494-b64f22f4023e service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:20.813259 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-2a0a59bd-5162-4b68-9b11-4c7c67e28a95 req-feeaab9d-bc8e-4b52-9494-b64f22f4023e service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:20.832775 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-2a0a59bd-5162-4b68-9b11-4c7c67e28a95 req-feeaab9d-bc8e-4b52-9494-b64f22f4023e service nova] Creating event network-changed:63c57279-c059-45a9-8152-5e9016099229 for instance 059752c3-215f-4f88-bda4-89a71334a7ad on hv-cinder-78693 Apr 20 19:13:20.838178 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-2a0a59bd-5162-4b68-9b11-4c7c67e28a95 req-feeaab9d-bc8e-4b52-9494-b64f22f4023e service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042738 Apr 20 19:13:20.838988 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 765/1431] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:13:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:13:20.844364 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:20.845132 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:20.853493 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:20.853996 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:20.854857 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:20.855340 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:21.515972 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:13:21.526333 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-d7c50cd0-923c-43ba-b7c4-b04abb0227a8 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1576 microversion: 2.1 time: 0.685250 Apr 20 19:13:21.526606 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 766/1432] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:20 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1576 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:13:22.545768 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:22.546447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:22.555270 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:22.555778 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:22.556628 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:22.557115 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:22.998583 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:13:23.007825 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-9f3ff1bc-3eec-4a22-8c24-f330a3482b2b tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1457 microversion: 2.1 time: 0.466497 Apr 20 19:13:23.008463 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 767/1433] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:22 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1457 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:13:23.494777 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [req-86b0e6e9-1703-475b-98a4-26819e158bea req-71d58482-fb00-4681-8daa-8b1ab33b86b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059752c3-215f-4f88-bda4-89a71334a7ad", "name": "network-vif-deleted", "tag": "63c57279-c059-45a9-8152-5e9016099229"}]} {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:13:23.496665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:13:23.496665 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: warnings.warn(msg) Apr 20 19:13:23.506850 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-86b0e6e9-1703-475b-98a4-26819e158bea req-71d58482-fb00-4681-8daa-8b1ab33b86b6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:23.507361 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [req-86b0e6e9-1703-475b-98a4-26819e158bea req-71d58482-fb00-4681-8daa-8b1ab33b86b6 service nova] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:23.527017 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.compute.server_external_events [req-86b0e6e9-1703-475b-98a4-26819e158bea req-71d58482-fb00-4681-8daa-8b1ab33b86b6 service nova] Creating event network-vif-deleted:63c57279-c059-45a9-8152-5e9016099229 for instance 059752c3-215f-4f88-bda4-89a71334a7ad on hv-cinder-78693 Apr 20 19:13:23.532511 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [req-86b0e6e9-1703-475b-98a4-26819e158bea req-71d58482-fb00-4681-8daa-8b1ab33b86b6 service nova] 10.222.0.22 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041701 Apr 20 19:13:23.533323 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 768/1434] 10.222.0.22 () {64 vars in 1308 bytes} [Tue Apr 20 19:13:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:13:24.028552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:24.028552 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:24.036096 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:24.036604 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:24.037455 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:24.037944 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:24.111447 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:24.111949 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:24.113084 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.objects.instance [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lazy-loading 'fault' on Instance uuid 059752c3-215f-4f88-bda4-89a71334a7ad {{(pid=100570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:13:24.197592 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.policy [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95d15dca78f4f71883aaac8327831ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae127a36d1f43d28692c8a8bab8cf98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100570) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:13:24.207218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-37288742-a777-4bf9-96c2-8421aa9495a5 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 200 len: 1230 microversion: 2.1 time: 0.185392 Apr 20 19:13:24.207849 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 769/1435] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:24 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 1230 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:13:25.225937 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:25.226632 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 059752c3-215f-4f88-bda4-89a71334a7ad] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:25.234717 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:25.235223 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:25.236053 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:25.236540 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:25.292059 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] HTTP exception thrown: Instance 059752c3-215f-4f88-bda4-89a71334a7ad could not be found. Apr 20 19:13:25.292725 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Returning 404 to user: Instance 059752c3-215f-4f88-bda4-89a71334a7ad could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:13:25.293638 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-def530d0-32af-4770-89c0-111208e36a7f tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad" status: 404 len: 111 microversion: 2.1 time: 0.071898 Apr 20 19:13:25.294249 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 770/1436] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:25 2021] GET /compute/v2.1/servers/059752c3-215f-4f88-bda4-89a71334a7ad => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:13:26.134883 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:26.135431 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:26.143218 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:26.144257 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:26.145082 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:26.145566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:26.198388 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] HTTP exception thrown: Instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 could not be found. Apr 20 19:13:26.199070 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Returning 404 to user: Instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:13:26.199976 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-530e6f56-a73f-456c-93c3-9a5e9d5dcb64 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "DELETE /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 404 len: 111 microversion: 2.1 time: 0.069481 Apr 20 19:13:26.200582 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 771/1437] 10.222.0.22 () {58 vars in 1229 bytes} [Tue Apr 20 19:13:26 2021] DELETE /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:13:26.209567 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:26.210230 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.compute.api [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] [instance: 332dffbc-fb8f-4dd4-9a91-d62e149d4d37] Fetching instance by UUID {{(pid=100570) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:13:26.218027 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:26.218561 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:26.219384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:13:26.219869 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG oslo_concurrency.lockutils [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Lock "fed6a0e7-292a-432d-90d4-b7835fd301db" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100570) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:13:26.272728 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.wsgi [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] HTTP exception thrown: Instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 could not be found. Apr 20 19:13:26.273384 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Returning 404 to user: Instance 332dffbc-fb8f-4dd4-9a91-d62e149d4d37 could not be found. {{(pid=100570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:13:26.274286 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-f936f9ae-0d77-41a6-947d-3b1ce3b298e3 tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37" status: 404 len: 111 microversion: 2.1 time: 0.069148 Apr 20 19:13:26.274920 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 772/1438] 10.222.0.22 () {58 vars in 1226 bytes} [Tue Apr 20 19:13:26 2021] GET /compute/v2.1/servers/332dffbc-fb8f-4dd4-9a91-d62e149d4d37 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:13:27.749837 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: DEBUG nova.api.openstack.wsgi [None req-4a2b77df-a60f-4982-b9d3-c0e6d42b5fad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] Calling method '.version_select at 0x7f1a1741c950>' {{(pid=100570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:13:27.771295 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO nova.api.openstack.requestlog [None req-4a2b77df-a60f-4982-b9d3-c0e6d42b5fad tempest-TestVolumeBootPattern-612673913 tempest-TestVolumeBootPattern-612673913-project] 10.222.0.22 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2111008047" status: 202 len: 0 microversion: 2.1 time: 0.025420 Apr 20 19:13:27.772022 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: [pid: 100570|app: 0|req: 773/1439] 10.222.0.22 () {58 vars in 1253 bytes} [Tue Apr 20 19:13:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2111008047 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:14:10.916191 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:14:10.916789 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:14:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:16:05.175050 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:16:05.175528 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:16:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:16:07.930000 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:16:07.930566 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:16:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:17:30.933956 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:17:30.934495 dv-cinder-786930-2-iscsi devstack@n-api.service[100567]: Tue Apr 20 19:17:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!